Sep 12 07:07:46 devstack cinder-volume[77019]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 12 07:07:46 devstack cinder-volume[77019]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 12 07:07:46 devstack cinder-volume[77019]: we strongly recommend against using it for new projects. Sep 12 07:07:46 devstack cinder-volume[77019]: If you are already using Eventlet, we recommend migrating to a different Sep 12 07:07:46 devstack cinder-volume[77019]: framework. For more detail see Sep 12 07:07:46 devstack cinder-volume[77019]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 12 07:07:46 devstack cinder-volume[77019]: import eventlet # noqa Sep 12 07:07:49 devstack cinder-volume[77019]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:07:49 devstack cinder-volume[77019]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:07:49 devstack cinder-volume[77019]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:07:49 devstack cinder-volume[77019]: INFO dbcounter [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Registered counter for database cinder Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG oslo_db.sqlalchemy.engines [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG dbcounter [-] [77019] Writer thread running {{(pid=77019) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 12 07:07:50 devstack cinder-volume[77019]: INFO cinder.rpc [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 12 07:07:50 devstack cinder-volume[77019]: INFO cinder.rpc [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG oslo_db.sqlalchemy.engines [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:07:50 devstack cinder-volume[77019]: INFO cinder.volume.manager [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Determined volume DB was empty at startup. Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG cinder.volume.manager [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77019) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 12 07:07:50 devstack cinder-volume[77019]: INFO cinder.volume.manager [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 12 07:07:50 devstack cinder-volume[77019]: WARNING stevedore.named [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 12 07:07:50 devstack cinder-volume[77019]: WARNING castellan.key_manager [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:07:50 devstack cinder-volume[77019]: WARNING cinder.keymgr.conf_key_mgr [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG cinder.volume.drivers.lvm [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77019) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG oslo_concurrency.processutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77019) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:50 devstack cinder-volume[77019]: DEBUG oslo_concurrency.processutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] CMD "cinder-rtstool verify" returned: 0 in 0.395s {{(pid=77019) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_db.sqlalchemy.engines [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:07:51 devstack cinder-volume[77019]: INFO cinder.rpc [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 12 07:07:51 devstack cinder-volume[77019]: INFO cinder.rpc [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 12 07:07:51 devstack cinder-volume[77019]: WARNING stevedore.named [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 12 07:07:51 devstack cinder-volume[77019]: WARNING castellan.key_manager [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:07:51 devstack cinder-volume[77019]: INFO cinder.volume.manager [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_db.sqlalchemy.engines [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:07:51 devstack cinder-volume[77019]: INFO oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Starting 1 workers Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Started child 77172 {{(pid=77019) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Full set of CONF: {{(pid=77019) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] ******************************************************************************** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Configuration options gathered from: {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 12 07:07:51 devstack cinder-volume[77172]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] ================================================================================ {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] allow_availability_zone_fallback = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] allow_compression_on_image_upload = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] allowed_direct_url_schemes = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] api_rate_limit = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] auth_strategy = keystone {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] az_cache_duration = 3600 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_availability_zone = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_host = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_stats_polling_interval = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backup_api_class = cinder.backup.api.API {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backup_name_template = backup-%s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backup_use_same_host = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backup_use_temp_snapshot = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] chap_password = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] chap_username = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_internal_tenant_project_id = 3441d8457ca24c93aaea5992e298f91d {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_internal_tenant_user_id = 25cbfd8fabef4afeaf6dfb06641c84a4 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cloned_volume_same_az = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cluster = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] compression_format = gzip {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] compute_api_class = cinder.compute.nova.API {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] config_dir = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] config_source = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] control_exchange = openstack {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] debug = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] default_availability_zone = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] default_group_type = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] default_volume_type = lvmdriver-1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] disk_geometry = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] driver_client_cert = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] driver_client_cert_key = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] driver_data_namespace = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] driver_ssl_cert_path = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] driver_ssl_cert_verify = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] driver_use_ssl = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] enable_force_upload = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] enable_new_services = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] enable_unsupported_driver = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] enabled_backends = ['lvmdriver-1'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] enforce_multipath_for_image_xfer = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] filter_function = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_api_insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_api_ssl_compression = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_ca_certificates_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_catalog_info = image:glance:publicURL {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_num_retries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance_request_timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] goodness_function = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] graceful_shutdown_timeout = 5 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] group_api_class = cinder.group.api.API {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] host = devstack {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_compress_on_upload = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_conversion_address_space_limit = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_conversion_cpu_limit = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_conversion_disable = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_introspection_address_space_limit = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_introspection_cpu_limit = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_upload_use_cinder_backend = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77172]: INFO cinder.volume.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_upload_use_internal_tenant = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_volume_cache_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_volume_cache_max_count = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] image_volume_cache_max_size_gb = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] init_host_max_objects_retrieval = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] instance_format = [instance: %(uuid)s] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] iscsi_target_flags = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] iscsi_write_cache = on {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] iser_helper = tgtadm {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] iser_ip_address = 192.168.122.48 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] iser_port = 3260 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_color = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_config_append = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_dir = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_options = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_rotate_interval = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_rotate_interval_type = days {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] log_rotation_type = none {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] max_age = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] max_logfile_count = 30 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] max_logfile_size_mb = 200 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] max_over_subscription_ratio = 20.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] message_reap_interval = 86400 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] message_ttl = 2592000 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] migration_create_volume_timeout_secs = 300 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] monkey_patch = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] monkey_patch_modules = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] my_ip = 192.168.122.48 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] no_snapshot_gb_quota = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] num_iser_scan_tries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] num_shell_tries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] num_volume_device_scan_tries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] nvmeof_conn_info_version = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] nvmet_ns_id = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] nvmet_port_id = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_max_limit = 1000 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_volume_ext_list = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_volume_listen = 0.0.0.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_volume_listen_port = 8776 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_volume_use_ssl = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] osapi_volume_workers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] per_volume_size_limit = -1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] periodic_fuzzy_delay = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] periodic_interval = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] project_id_regex = [0-9a-f\-]+ {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] public_endpoint = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] publish_errors = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_backup_gigabytes = 1000 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_backups = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_gigabytes = 1000 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_groups = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_snapshots = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] quota_volumes = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] rate_limit_burst = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] rate_limit_except_level = CRITICAL {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] rate_limit_interval = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] reinit_driver_count = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] replication_device = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] report_discard_supported = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] report_interval = 120 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] reservation_clean_interval = 86400 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] reservation_expire = 86400 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] reserved_image_namespaces = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] reserved_percentage = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] rpc_response_timeout = 120 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] run_external_periodic_tasks = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] scst_target_driver = iscsi {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] scst_target_iqn_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_down_time = 720 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] shell_completion = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] snapshot_name_template = snapshot-%s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] snapshot_same_host = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.074s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] split_loggers = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] state_path = /opt/stack/data/cinder {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] storage_availability_zone = nova {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] storage_protocol = iSCSI {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] syslog_log_facility = LOG_USER {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] target_helper = lioadm {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] target_ip_address = 192.168.122.48 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] target_port = 3260 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] target_protocol = iscsi {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] target_secondary_ip_addresses = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] trace_flags = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] transfer_api_class = cinder.transfer.api.API {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] transport_url = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] until_refresh = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_chap_auth = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_default_quota_class = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_journal = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_json = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_multipath_for_image_xfer = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_stderr = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] use_syslog = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] verify_glance_signatures = enabled {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_api_class = cinder.volume.api.API {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_backend_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_clear = zero {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_clear_ionice = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_clear_size = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_copy_bps_limit = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_dd_blocksize = 1M {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_name_template = volume-%s {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_service_inithost_offload = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volume_usage_audit_period = month {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] zoning_mode = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_concurrency.disable_process_locking = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.auth_section = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.auth_type = password {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.auth_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.cache = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.delay_auth_decision = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.http_connect_timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.include_service_catalog = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.interface = public {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_password = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcache_username = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.region_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.service_token_roles_required = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.service_type = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.token_cache_time = 300 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.backend = dogpile.cache.null {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.backend_argument = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.backend_expiration_time = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.config_prefix = cache.oslo {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.debug_cache_backend = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.enable_retry_client = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.enable_socket_keepalive = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.expiration_time = 600 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.hashclient_retry_attempts = 2 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_dead_retry = 300 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_pool_maxsize = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_sasl_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.password = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.proxies = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.redis_db = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.redis_sentinel_service_name = mymaster {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.redis_server = localhost:6379 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.retry_attempts = 2 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.retry_delay = 0.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.socket_keepalive_count = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.socket_keepalive_idle = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.socket_keepalive_interval = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.socket_timeout = 1.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.tls_allowed_ciphers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.tls_cafile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.tls_certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.tls_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.tls_keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cache.username = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] coordination.backend_url = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.asyncio_connection = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.asyncio_slave_connection = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.backend = sqlalchemy {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.connection = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.connection_debug = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.connection_parameters = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.connection_recycle_time = 3600 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.connection_trace = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.db_inc_retry_interval = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.db_max_retries = 20 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.db_max_retry_interval = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.db_retry_interval = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.max_overflow = 50 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.max_pool_size = 5 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.max_retries = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.mysql_wsrep_sync_wait = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.pool_timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.retry_interval = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.slave_connection = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.sqlite_synchronous = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.synchronous_reader = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] database.use_db_reconnect = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_tracing.insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.connection_string = messaging:// {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.es_doc_type = notification {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.es_scroll_size = 10000 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.es_scroll_time = 2m {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.filter_error_trace = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.hmac_keys = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.sentinel_service_name = mymaster {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.socket_timeout = 0.1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.trace_requests = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler.trace_sqlalchemy = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler_jaeger.process_tags = {} {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler_jaeger.service_name_prefix = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] profiler_otlp.service_name_prefix = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.enforce_new_defaults = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.policy_default_rule = default {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.policy_file = policy.yaml {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_policy.remote_timeout = 60.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.group = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.helper_command = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] privsep_osbrick.user = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.group = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.helper_command = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] cinder_sys_admin.user = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.auth_section = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.auth_type = password {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.cafile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.collect_timing = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.send_service_user_token = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.split_loggers = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.tls_ciphers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] service_user.tls_min_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.auth_section = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.auth_type = password {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.collect_timing = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.region_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.split_loggers = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.tls_ciphers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] glance.tls_min_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.backend_availability_zone = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.chap_password = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.chap_username = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.disk_geometry = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.driver_client_cert = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.driver_client_cert_key = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.driver_data_namespace = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.driver_use_ssl = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.enable_unsupported_driver = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.extra_capabilities = {} {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.filter_function = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.goodness_function = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.iscsi_target_flags = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.iscsi_write_cache = on {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.iser_helper = tgtadm {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.iser_port = 3260 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.lvm_mirrors = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.lvm_share_target = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.lvm_type = auto {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.num_shell_tries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.nvmet_port_id = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.replication_device = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.report_discard_supported = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.reserved_percentage = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.scst_target_driver = iscsi {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.scst_target_iqn_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.storage_protocol = iSCSI {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.target_helper = tgtadm {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.target_port = 3260 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.target_protocol = iscsi {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.trace_flags = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.unique_fqdn_network = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.use_chap_auth = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_backend_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_clear = zero {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_clear_ionice = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_clear_size = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volume_group = cinder-volumes {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_reports.file_event_handler = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_reports.log_dir = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.backend_availability_zone = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.backend_host = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.chap_password = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.chap_username = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.chiscsi_conf = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.disk_geometry = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.driver_client_cert = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.driver_data_namespace = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.driver_use_ssl = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.extra_capabilities = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.filter_function = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.goodness_function = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.iser_helper = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.iser_ip_address = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.iser_port = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.iser_target_prefix = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.lvm_conf_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.lvm_mirrors = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.lvm_share_target = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.lvm_type = auto {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.num_shell_tries = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.nvmet_port_id = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.replication_device = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.report_discard_supported = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.reserved_percentage = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.scst_target_driver = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.storage_protocol = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.target_helper = lioadm {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.target_ip_address = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.target_port = 3260 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.target_protocol = iscsi {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.trace_flags = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.use_chap_auth = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_clear = zero {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_clear_size = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] lvmdriver-1.volumes_dir = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.ssl_version = {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_notifications.driver = [] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_notifications.retry = -1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] oslo_messaging_notifications.transport_url = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] key_manager.fixed_key = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.barbican_api_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.barbican_endpoint = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.barbican_endpoint_type = public {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.barbican_region_name = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.cafile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.collect_timing = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.number_of_retries = 60 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.retry_delay = 1 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.send_service_user_token = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.split_loggers = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.tls_ciphers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.tls_min_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.verify_ssl = True {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican.verify_ssl_path = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.auth_section = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.auth_type = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.cafile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.certfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.collect_timing = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.insecure = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.keyfile = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.split_loggers = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.timeout = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.tls_ciphers = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] barbican_service_user.tls_min_version = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.approle_role_id = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.approle_secret_id = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.auth_method = approle {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.auth_path = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.kv_mountpoint = secret {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.kv_path = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.kv_version = 2 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.namespace = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.root_token_id = **** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.ssl_ca_crt_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.timeout = 60.0 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.token_file = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.token_role = None {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.use_ssl = False {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:07:51 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] ******************************************************************************** {{(pid=77019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 12 07:07:51 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:51 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:51 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:51 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:52 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.343s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:07:52 devstack cinder-volume[77172]: INFO cinder.brick.local_dev.lvm [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:52 devstack sudo[77434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:07:52 devstack sudo[77434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:52 devstack sudo[77434]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG cinder.brick.local_dev.lvm [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77172) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:52 devstack sudo[77522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:52 devstack sudo[77522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:52 devstack sudo[77522]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:52 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:53 devstack sudo[77713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:53 devstack sudo[77713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:53 devstack sudo[77713]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:53 devstack sudo[77816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 12 07:07:53 devstack sudo[77816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:53 devstack sudo[77816]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.258s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:53 devstack sudo[77819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:07:53 devstack sudo[77819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:53 devstack sudo[77819]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:53 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:53 devstack sudo[77903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:07:53 devstack sudo[77903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:54 devstack sudo[77903]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:54 devstack sudo[77906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:54 devstack sudo[77906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:54 devstack sudo[77906]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:54 devstack sudo[77940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:54 devstack sudo[77940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:54 devstack sudo[77940]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:54 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:54 devstack sudo[78000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:54 devstack sudo[78000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:55 devstack sudo[78000]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:55 devstack cinder-volume[77172]: INFO cinder.volume.drivers.lvm [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:55 devstack sudo[78004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:55 devstack sudo[78004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:55 devstack sudo[78004]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:55 devstack sudo[78013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:07:55 devstack sudo[78013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:55 devstack sudo[78013]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:55 devstack sudo[78016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:55 devstack sudo[78016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:55 devstack sudo[78016]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:55 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:55 devstack sudo[78019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:55 devstack sudo[78019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:56 devstack sudo[78019]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.237s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:56 devstack sudo[78022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:56 devstack sudo[78022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:56 devstack sudo[78022]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:56 devstack cinder-volume[77172]: INFO cinder.volume.driver [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Driver hasn't implemented _init_vendor_properties() Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG cinder.volume.driver [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77172) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77172) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG dbcounter [-] [77172] Writer thread running {{(pid=77172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG cinder.db.api [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Building query based on filter {{(pid=77172) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG cinder.image.image_utils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77172) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 12 07:07:56 devstack cinder-volume[77172]: INFO cinder.keymgr.migration [None req-5719d36b-25d3-4681-bd8f-cf9ee0f0ad6f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:56 devstack sudo[78025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:07:56 devstack sudo[78025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:56 devstack sudo[78025]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:56 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:56 devstack sudo[78030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:56 devstack sudo[78030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:57 devstack sudo[78030]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:57 devstack sudo[78033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:57 devstack sudo[78033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:57 devstack sudo[78033]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:57 devstack sudo[78037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:57 devstack sudo[78037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:57 devstack sudo[78037]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG cinder.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Notifying Schedulers of capabilities ... {{(pid=77172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:07:57 devstack cinder-volume[77172]: INFO cinder.volume.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Driver initialization completed successfully. Sep 12 07:07:57 devstack cinder-volume[77172]: INFO cinder.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Initiating service 2 cleanup Sep 12 07:07:57 devstack cinder-volume[77172]: INFO cinder.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Service 2 cleanup completed. Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG cinder.service [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Creating RPC server for service cinder-volume {{(pid=77172) start /opt/stack/cinder/cinder/service.py:231}} Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG cinder.service [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77172) start /opt/stack/cinder/cinder/service.py:237}} Sep 12 07:07:57 devstack cinder-volume[77172]: INFO cinder.volume.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:07:57 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:57 devstack sudo[78040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:07:57 devstack sudo[78040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:58 devstack sudo[78040]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:58 devstack sudo[78045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:58 devstack sudo[78045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:58 devstack sudo[78045]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:58 devstack sudo[78048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:07:58 devstack sudo[78048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:58 devstack sudo[78048]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:07:58 devstack sudo[78054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:07:58 devstack sudo[78054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:07:58 devstack sudo[78054]: pam_unix(sudo:session): session closed for user root Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:07:58 devstack cinder-volume[77172]: INFO cinder.volume.manager [None req-1c2558a5-6acb-4027-b9fa-6a7656cf2f15 None None] Driver post RPC initialization completed successfully. Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager._thread_info {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread count: 6 {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:07:58 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread info: [<_MainThread(MainThread, started 131238372098176)>, , , , , ] {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:08:01 devstack cinder-volume[77019]: DEBUG dbcounter [-] [77019] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77019) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:08:07 devstack cinder-volume[77172]: DEBUG dbcounter [-] [77172] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:08:08 devstack cinder-volume[77172]: DEBUG dbcounter [-] [77172] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=77172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:08:58 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:08:58 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:08:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:08:58 devstack sudo[80079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:08:58 devstack sudo[80079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:08:59 devstack sudo[80079]: pam_unix(sudo:session): session closed for user root Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:08:59 devstack sudo[80082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:08:59 devstack sudo[80082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:08:59 devstack sudo[80082]: pam_unix(sudo:session): session closed for user root Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:08:59 devstack sudo[80085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:08:59 devstack sudo[80085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:08:59 devstack sudo[80085]: pam_unix(sudo:session): session closed for user root Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:08:59 devstack sudo[80088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:08:59 devstack sudo[80088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:08:59 devstack sudo[80088]: pam_unix(sudo:session): session closed for user root Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG cinder.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Notifying Schedulers of capabilities ... {{(pid=77172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager._thread_info {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread count: 6 {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:08:59 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread info: [<_MainThread(MainThread, started 131238372098176)>, , , , , ] {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:09:58 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:09:58 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:09:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:09:58 devstack sudo[83457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:09:58 devstack sudo[83457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:09:59 devstack sudo[83457]: pam_unix(sudo:session): session closed for user root Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:09:59 devstack sudo[83460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:09:59 devstack sudo[83460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:09:59 devstack sudo[83460]: pam_unix(sudo:session): session closed for user root Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:09:59 devstack sudo[83464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:09:59 devstack sudo[83464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:09:59 devstack sudo[83464]: pam_unix(sudo:session): session closed for user root Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:09:59 devstack sudo[83468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:09:59 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:09:59 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG cinder.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Notifying Schedulers of capabilities ... {{(pid=77172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager._thread_info {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread count: 6 {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:09:59 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread info: [<_MainThread(MainThread, started 131238372098176)>, , , , , ] {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:10:08 devstack cinder-volume[77172]: DEBUG dbcounter [-] [77172] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:10:58 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:10:58 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:10:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:10:58 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:10:58 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:10:59 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:10:59 devstack sudo[85491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:10:59 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:10:59 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:10:59 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:10:59 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:10:59 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:10:59 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:10:59 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:10:59 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:10:59 devstack cinder-volume[77172]: DEBUG cinder.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Notifying Schedulers of capabilities ... {{(pid=77172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:11:58 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:11:58 devstack cinder-volume[77172]: DEBUG cinder.volume.drivers.lvm [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Updating volume stats {{(pid=77172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 12 07:11:58 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:11:58 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 12 07:11:58 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:11:59 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:11:59 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:11:59 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:11:59 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:11:59 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 12 07:11:59 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:11:59 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:11:59 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 12 07:11:59 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:11:59 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_concurrency.processutils [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG cinder.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Notifying Schedulers of capabilities ... {{(pid=77172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG oslo_service.periodic_task [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] Running periodic task VolumeManager._thread_info {{(pid=77172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread count: 6 {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:11:59 devstack cinder-volume[77172]: DEBUG cinder.volume.manager [None req-f70e82dc-45bc-4077-98b0-2d4f8d589ace None None] thread info: [<_MainThread(MainThread, started 131238372098176)>, , , , , ] {{(pid=77172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:12:08 devstack cinder-volume[77172]: DEBUG dbcounter [-] [77172] Writing DB stats cinder:SELECT=1 {{(pid=77172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:12:08 devstack cinder-volume[77172]: DEBUG dbcounter [-] [77172] Writing DB stats cinder:UPDATE=1 {{(pid=77172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:12:12 devstack cinder-volume[77019]: INFO oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Caught SIGTERM, stopping children Sep 12 07:12:12 devstack cinder-volume[77019]: DEBUG oslo_concurrency.lockutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Acquiring lock "singleton_lock" {{(pid=77019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:12:12 devstack cinder-volume[77019]: DEBUG oslo_concurrency.lockutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Acquired lock "singleton_lock" {{(pid=77019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:12:12 devstack cinder-volume[77019]: DEBUG oslo_concurrency.lockutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Releasing lock "singleton_lock" {{(pid=77019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:12:12 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Stop services. {{(pid=77019) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 12 07:12:12 devstack cinder-volume[77019]: DEBUG oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Killing children. {{(pid=77019) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 12 07:12:12 devstack cinder-volume[77019]: INFO oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Waiting on 1 children to exit Sep 12 07:12:12 devstack cinder-volume[77172]: DEBUG oslo_concurrency.lockutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Acquiring lock "singleton_lock" {{(pid=77172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:12:12 devstack cinder-volume[77172]: DEBUG oslo_concurrency.lockutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Acquired lock "singleton_lock" {{(pid=77172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:12:12 devstack cinder-volume[77172]: DEBUG oslo_concurrency.lockutils [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Releasing lock "singleton_lock" {{(pid=77172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:12:12 devstack cinder-volume[77172]: WARNING amqp [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 12 07:12:12 devstack cinder-volume[77172]: WARNING amqp [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 12 07:12:12 devstack cinder-volume[77019]: INFO oslo_service.backend._eventlet.service [None req-005d4a21-d3e5-476a-a575-e9dae927899c None None] Child 77172 exited with status 0 Sep 12 07:12:13 devstack cinder-volume[87188]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 12 07:12:13 devstack cinder-volume[87188]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 12 07:12:13 devstack cinder-volume[87188]: we strongly recommend against using it for new projects. Sep 12 07:12:13 devstack cinder-volume[87188]: If you are already using Eventlet, we recommend migrating to a different Sep 12 07:12:13 devstack cinder-volume[87188]: framework. For more detail see Sep 12 07:12:13 devstack cinder-volume[87188]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 12 07:12:13 devstack cinder-volume[87188]: import eventlet # noqa Sep 12 07:12:15 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:12:15 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:12:15 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:12:15 devstack cinder-volume[87188]: INFO dbcounter [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Registered counter for database cinder Sep 12 07:12:15 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG dbcounter [-] [87188] Writer thread running {{(pid=87188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 12 07:12:16 devstack cinder-volume[87188]: INFO cinder.rpc [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 12 07:12:16 devstack cinder-volume[87188]: INFO cinder.rpc [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:16 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Determined volume DB was empty at startup. Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG cinder.volume.manager [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87188) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 12 07:12:16 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 12 07:12:16 devstack cinder-volume[87188]: WARNING stevedore.named [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 12 07:12:16 devstack cinder-volume[87188]: WARNING castellan.key_manager [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:12:16 devstack cinder-volume[87188]: WARNING cinder.keymgr.conf_key_mgr [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:12:16 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:16 devstack cinder-volume[87188]: INFO oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Starting 1 workers Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Started child 87405 {{(pid=87188) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Full set of CONF: {{(pid=87188) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] ******************************************************************************** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Configuration options gathered from: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 12 07:12:16 devstack cinder-volume[87405]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] ================================================================================ {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] allow_availability_zone_fallback = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] allow_compression_on_image_upload = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] allowed_direct_url_schemes = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] api_rate_limit = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] auth_strategy = keystone {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_availability_zone = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_host = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_stats_polling_interval = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backup_api_class = cinder.backup.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backup_name_template = backup-%s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backup_use_same_host = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87405]: INFO cinder.volume.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.remotefs [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87405) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backup_use_temp_snapshot = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] chap_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] chap_username = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_internal_tenant_project_id = 3441d8457ca24c93aaea5992e298f91d {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_internal_tenant_user_id = 25cbfd8fabef4afeaf6dfb06641c84a4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cluster = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] compression_format = gzip {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] compute_api_class = cinder.compute.nova.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] config_dir = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] config_source = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] control_exchange = openstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] debug = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] default_availability_zone = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] default_group_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] default_volume_type = QuobyteHD {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] disk_geometry = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] driver_client_cert = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] driver_client_cert_key = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] driver_data_namespace = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] driver_ssl_cert_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] driver_ssl_cert_verify = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] driver_use_ssl = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] enable_new_services = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] enable_unsupported_driver = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] enabled_backends = ['QuobyteHD'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] enforce_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] filter_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_api_insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_api_ssl_compression = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_ca_certificates_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_catalog_info = image:glance:publicURL {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_num_retries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance_request_timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] goodness_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] graceful_shutdown_timeout = 5 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] group_api_class = cinder.group.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] host = devstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_compress_on_upload = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_conversion_address_space_limit = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_conversion_cpu_limit = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_conversion_disable = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_introspection_address_space_limit = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_introspection_cpu_limit = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_upload_use_cinder_backend = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_upload_use_internal_tenant = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_volume_cache_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_volume_cache_max_count = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] image_volume_cache_max_size_gb = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] init_host_max_objects_retrieval = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] instance_format = [instance: %(uuid)s] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] iscsi_target_flags = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] iscsi_write_cache = on {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] iser_helper = tgtadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] iser_ip_address = 192.168.122.48 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] iser_port = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87405) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 12 07:12:16 devstack cinder-volume[87405]: WARNING cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 12 07:12:16 devstack cinder-volume[87405]: WARNING cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Running cmd (subprocess): mount.quobyte {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_color = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_config_append = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_dir = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_options = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_rotate_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_rotate_interval_type = days {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] log_rotation_type = none {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] max_age = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] max_logfile_count = 30 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] max_logfile_size_mb = 200 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] max_over_subscription_ratio = 20.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] message_reap_interval = 86400 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] message_ttl = 2592000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] migration_create_volume_timeout_secs = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] monkey_patch = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] monkey_patch_modules = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] my_ip = 192.168.122.48 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] no_snapshot_gb_quota = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] num_iser_scan_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] num_shell_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] num_volume_device_scan_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] nvmeof_conn_info_version = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] nvmet_ns_id = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] nvmet_port_id = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_max_limit = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_volume_ext_list = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_volume_listen_port = 8776 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_volume_use_ssl = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] osapi_volume_workers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] per_volume_size_limit = -1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] periodic_fuzzy_delay = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] periodic_interval = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] public_endpoint = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] publish_errors = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_backup_gigabytes = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_backups = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_gigabytes = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_groups = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_snapshots = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] quota_volumes = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] rate_limit_burst = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] rate_limit_except_level = CRITICAL {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] rate_limit_interval = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] reinit_driver_count = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] replication_device = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] report_discard_supported = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] report_interval = 120 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] reservation_clean_interval = 86400 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] reservation_expire = 86400 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] reserved_image_namespaces = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] reserved_percentage = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] rpc_response_timeout = 120 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] run_external_periodic_tasks = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] scst_target_driver = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] scst_target_iqn_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_down_time = 720 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] shell_completion = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] snapshot_name_template = snapshot-%s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] split_loggers = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] state_path = /opt/stack/data/cinder {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] storage_availability_zone = nova {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] storage_protocol = iSCSI {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] syslog_log_facility = LOG_USER {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] target_helper = lioadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] target_ip_address = 192.168.122.48 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] target_port = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] target_protocol = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] target_secondary_ip_addresses = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] trace_flags = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] transport_url = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] until_refresh = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_chap_auth = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_default_quota_class = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_journal = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_json = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_stderr = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] use_syslog = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] verify_glance_signatures = enabled {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_api_class = cinder.volume.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_backend_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_clear = zero {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_clear_ionice = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_clear_size = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_copy_bps_limit = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_dd_blocksize = 1M {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_name_template = volume-%s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_service_inithost_offload = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volume_usage_audit_period = month {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] zoning_mode = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_concurrency.disable_process_locking = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.auth_section = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.auth_type = password {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.auth_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.cache = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.include_service_catalog = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.interface = public {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack quobyte-client[87406]: Reading configuration file: /etc/quobyte/client.cfg Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcache_username = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.region_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack quobyte-client[87406]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.service_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.backend = dogpile.cache.null {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.backend_argument = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.backend_expiration_time = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.config_prefix = cache.oslo {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.debug_cache_backend = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=87405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.enable_retry_client = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.enable_socket_keepalive = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87405]: INFO cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 ... Sep 12 07:12:16 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d -c /etc/quobyte/client-cinder.cfg {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.expiration_time = 600 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.hashclient_retry_attempts = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_dead_retry = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_pool_maxsize = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_sasl_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.proxies = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.redis_db = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.redis_server = localhost:6379 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.retry_attempts = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.retry_delay = 0.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.socket_keepalive_count = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.socket_keepalive_idle = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.socket_keepalive_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.socket_timeout = 1.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.tls_allowed_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.tls_cafile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.tls_certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.tls_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.tls_keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cache.username = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] coordination.backend_url = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.asyncio_connection = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.asyncio_slave_connection = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.backend = sqlalchemy {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.connection = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.connection_debug = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.connection_parameters = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.connection_recycle_time = 3600 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.connection_trace = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.db_inc_retry_interval = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.db_max_retries = 20 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.db_max_retry_interval = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.db_retry_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.max_overflow = 50 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.max_pool_size = 5 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.max_retries = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.mysql_wsrep_sync_wait = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.pool_timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.retry_interval = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.slave_connection = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.sqlite_synchronous = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.synchronous_reader = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] database.use_db_reconnect = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_tracing.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.connection_string = messaging:// {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.es_doc_type = notification {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.es_scroll_size = 10000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.es_scroll_time = 2m {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.filter_error_trace = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.hmac_keys = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.sentinel_service_name = mymaster {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.socket_timeout = 0.1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.trace_requests = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler.trace_sqlalchemy = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler_jaeger.process_tags = {} {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler_jaeger.service_name_prefix = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] profiler_otlp.service_name_prefix = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.enforce_new_defaults = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.policy_default_rule = default {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.policy_file = policy.yaml {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.group = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.helper_command = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] privsep_osbrick.user = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.group = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.helper_command = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d -c /etc/quobyte/client-cinder.cfg Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] cinder_sys_admin.user = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.auth_section = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.auth_type = password {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.cafile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.collect_timing = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.send_service_user_token = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.split_loggers = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.tls_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] service_user.tls_min_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.auth_section = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.auth_type = password {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.collect_timing = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.region_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.split_loggers = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.tls_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] glance.tls_min_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.backend_availability_zone = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.chap_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.chap_username = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.disk_geometry = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.driver_client_cert = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.driver_client_cert_key = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.driver_data_namespace = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.driver_use_ssl = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.extra_capabilities = {} {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.filter_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.goodness_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.iscsi_target_flags = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.iscsi_write_cache = on {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.iser_helper = tgtadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.iser_port = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_host = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_login = admin {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_mount_options = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_private_key = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_share_path = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.num_shell_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.quobyte_volume_url = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.replication_device = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.report_discard_supported = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.reserved_percentage = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.target_helper = tgtadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.target_port = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.target_protocol = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.trace_flags = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.unique_fqdn_network = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.use_chap_auth = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_backend_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_clear = zero {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_clear_ionice = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_clear_size = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_reports.file_event_handler = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_reports.log_dir = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.backend_availability_zone = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.backend_host = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.chap_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.chap_username = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.chiscsi_conf = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.disk_geometry = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.driver_client_cert = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.driver_data_namespace = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.driver_use_ssl = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.extra_capabilities = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.filter_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.goodness_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.iser_helper = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.iser_ip_address = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.iser_port = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.iser_target_prefix = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_host = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_login = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_mount_options = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_private_key = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_share_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_ssh_port = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.num_shell_tries = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.nvmet_port_id = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.replication_device = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.report_discard_supported = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.reserved_percentage = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.scst_target_driver = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.storage_protocol = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.target_helper = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.target_ip_address = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.target_port = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.target_prefix = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.target_protocol = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.trace_flags = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.use_chap_auth = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_clear = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_clear_size = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] QuobyteHD.volumes_dir = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_notifications.driver = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_notifications.retry = -1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] key_manager.fixed_key = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.barbican_api_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.barbican_endpoint = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.barbican_endpoint_type = public {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.barbican_region_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.cafile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.collect_timing = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.number_of_retries = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.retry_delay = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.send_service_user_token = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.split_loggers = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.tls_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.tls_min_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.verify_ssl = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican.verify_ssl_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.auth_section = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.auth_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.cafile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.collect_timing = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.split_loggers = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.tls_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] barbican_service_user.tls_min_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.approle_role_id = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.approle_secret_id = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.auth_method = approle {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.auth_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.kv_mountpoint = secret {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.kv_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.kv_version = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.namespace = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.root_token_id = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.ssl_ca_crt_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.timeout = 60.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.token_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.token_role = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.use_ssl = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:16 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] ******************************************************************************** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 12 07:12:17 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.489s {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 succeeded Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=87405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.506s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:17 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:17 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:17 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.236s {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.volume.driver [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Driver hasn't implemented _init_vendor_properties() Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.volume.driver [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1816902160645, 'free_capacity_gb': 1773.1816902160645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87405) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_db.sqlalchemy.engines [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87405) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG dbcounter [-] [87405] Writer thread running {{(pid=87405) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.db.api [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Building query based on filter {{(pid=87405) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.image.image_utils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87405) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.keymgr.migration [None req-fe8408bf-5ff6-4cab-a026-6cff5ee2970c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=87405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=87405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:17 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:17 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:17 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.225s {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Notifying Schedulers of capabilities ... {{(pid=87405) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.volume.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Driver initialization completed successfully. Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Initiating service 3 cleanup Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Service 3 cleanup completed. Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.service [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Creating RPC server for service cinder-volume {{(pid=87405) start /opt/stack/cinder/cinder/service.py:231}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.service [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87405) start /opt/stack/cinder/cinder/service.py:237}} Sep 12 07:12:17 devstack cinder-volume[87405]: INFO cinder.volume.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=87405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=87405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:17 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:17 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:17 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:18 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:18 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.248s {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:18 devstack cinder-volume[87405]: INFO cinder.volume.manager [None req-5a10e31a-ae67-4b52-8495-fb641b8e1c77 None None] Driver post RPC initialization completed successfully. Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=87405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG cinder.volume.drivers.quobyte [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=87405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:22 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:22 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:22 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG oslo_concurrency.processutils [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.227s {{(pid=87405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:22 devstack cinder-volume[87405]: DEBUG cinder.manager [None req-ecc17f54-d733-42ba-bc56-cc854cb3164c None None] Notifying Schedulers of capabilities ... {{(pid=87405) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:12:24 devstack cinder-volume[87405]: DEBUG oslo_service.periodic_task [None req-050a8822-8948-433f-b1f3-6b15ff29849c None None] Running periodic task VolumeManager._thread_info {{(pid=87405) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:12:24 devstack cinder-volume[87405]: DEBUG cinder.volume.manager [None req-050a8822-8948-433f-b1f3-6b15ff29849c None None] thread count: 6 {{(pid=87405) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:12:24 devstack cinder-volume[87405]: DEBUG cinder.volume.manager [None req-050a8822-8948-433f-b1f3-6b15ff29849c None None] thread info: [<_MainThread(MainThread, started 139201113194624)>, , , , , ] {{(pid=87405) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:12:26 devstack cinder-volume[87188]: INFO oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Caught SIGTERM, stopping children Sep 12 07:12:26 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Acquiring lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:12:26 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Acquired lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:12:26 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Releasing lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:12:26 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Stop services. {{(pid=87188) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 12 07:12:26 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Killing children. {{(pid=87188) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 12 07:12:26 devstack cinder-volume[87188]: INFO oslo_service.backend._eventlet.service [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Waiting on 1 children to exit Sep 12 07:12:28 devstack cinder-volume[87405]: DEBUG dbcounter [-] [87405] Writing DB stats cinder:SELECT=5 {{(pid=87405) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:12:28 devstack cinder-volume[87405]: DEBUG dbcounter [-] [87405] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87405) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:12:31 devstack cinder-volume[87405]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 12 07:12:31 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Acquiring lock "singleton_lock" {{(pid=87405) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:12:31 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Acquired lock "singleton_lock" {{(pid=87405) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:12:31 devstack cinder-volume[87405]: DEBUG oslo_concurrency.lockutils [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Releasing lock "singleton_lock" {{(pid=87405) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:12:31 devstack cinder-volume[87405]: WARNING amqp [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 12 07:12:31 devstack cinder-volume[87405]: WARNING amqp [None req-19e9db1a-5f92-47cf-9dfc-bee58f87b482 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 12 07:12:31 devstack cinder-volume[87725]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 12 07:12:31 devstack cinder-volume[87725]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 12 07:12:31 devstack cinder-volume[87725]: we strongly recommend against using it for new projects. Sep 12 07:12:31 devstack cinder-volume[87725]: If you are already using Eventlet, we recommend migrating to a different Sep 12 07:12:31 devstack cinder-volume[87725]: framework. For more detail see Sep 12 07:12:31 devstack cinder-volume[87725]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 12 07:12:31 devstack cinder-volume[87725]: import eventlet # noqa Sep 12 07:12:33 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 12 07:12:33 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 12 07:12:33 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 12 07:12:34 devstack cinder-volume[87725]: INFO dbcounter [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Registered counter for database cinder Sep 12 07:12:34 devstack cinder-volume[87725]: DEBUG oslo_db.sqlalchemy.engines [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:34 devstack cinder-volume[87725]: DEBUG dbcounter [-] [87725] Writer thread running {{(pid=87725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 12 07:12:34 devstack cinder-volume[87725]: INFO cinder.rpc [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 12 07:12:34 devstack cinder-volume[87725]: INFO cinder.rpc [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_db.sqlalchemy.engines [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:35 devstack cinder-volume[87725]: INFO cinder.volume.manager [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Determined volume DB was empty at startup. Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG cinder.volume.manager [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87725) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 12 07:12:35 devstack cinder-volume[87725]: WARNING stevedore.named [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 12 07:12:35 devstack cinder-volume[87725]: WARNING castellan.key_manager [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:12:35 devstack cinder-volume[87725]: WARNING cinder.keymgr.conf_key_mgr [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 12 07:12:35 devstack cinder-volume[87725]: INFO cinder.volume.manager [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_db.sqlalchemy.engines [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:35 devstack cinder-volume[87725]: INFO oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Starting 1 workers Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Started child 88013 {{(pid=87725) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Full set of CONF: {{(pid=87725) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] ******************************************************************************** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] Configuration options gathered from: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] ================================================================================ {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] allow_availability_zone_fallback = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] allow_compression_on_image_upload = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] allowed_direct_url_schemes = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] api_rate_limit = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] auth_strategy = keystone {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_host = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_stats_polling_interval = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[88013]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backup_api_class = cinder.backup.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backup_name_template = backup-%s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backup_use_same_host = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backup_use_temp_snapshot = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] chap_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] chap_username = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_internal_tenant_project_id = 3441d8457ca24c93aaea5992e298f91d {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_internal_tenant_user_id = 25cbfd8fabef4afeaf6dfb06641c84a4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cluster = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] compression_format = gzip {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] compute_api_class = cinder.compute.nova.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] config_dir = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] config_source = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] control_exchange = openstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] debug = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] default_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] default_group_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] default_volume_type = QuobyteHD {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] disk_geometry = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] driver_client_cert = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] driver_client_cert_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] driver_data_namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] driver_ssl_cert_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] driver_ssl_cert_verify = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] driver_use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] enable_new_services = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] enable_unsupported_driver = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] enabled_backends = ['QuobyteHD'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] enforce_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] filter_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_api_insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_api_ssl_compression = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_ca_certificates_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_catalog_info = image:glance:publicURL {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_num_retries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance_request_timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] goodness_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] graceful_shutdown_timeout = 5 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] group_api_class = cinder.group.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] host = devstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_compress_on_upload = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_conversion_address_space_limit = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_conversion_cpu_limit = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_conversion_disable = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_introspection_address_space_limit = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_introspection_cpu_limit = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_upload_use_cinder_backend = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_upload_use_internal_tenant = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_volume_cache_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_volume_cache_max_count = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] image_volume_cache_max_size_gb = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] init_host_max_objects_retrieval = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] instance_format = [instance: %(uuid)s] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] iscsi_target_flags = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] iscsi_write_cache = on {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] iser_helper = tgtadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] iser_ip_address = 192.168.122.48 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] iser_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88013) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_color = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_config_append = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_dir = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_options = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_rotate_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_rotate_interval_type = days {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] log_rotation_type = none {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] max_age = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] max_logfile_count = 30 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] max_logfile_size_mb = 200 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] max_over_subscription_ratio = 20.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] message_reap_interval = 86400 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] message_ttl = 2592000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] migration_create_volume_timeout_secs = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] monkey_patch = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] monkey_patch_modules = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] my_ip = 192.168.122.48 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] no_snapshot_gb_quota = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] num_iser_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] num_shell_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] num_volume_device_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] nvmeof_conn_info_version = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] nvmet_ns_id = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] nvmet_port_id = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_max_limit = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_volume_ext_list = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_volume_listen_port = 8776 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_volume_use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] osapi_volume_workers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] per_volume_size_limit = -1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] periodic_fuzzy_delay = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] periodic_interval = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] public_endpoint = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] publish_errors = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_backup_gigabytes = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_backups = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_gigabytes = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_groups = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_snapshots = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] quota_volumes = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] rate_limit_burst = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] rate_limit_except_level = CRITICAL {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] rate_limit_interval = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] reinit_driver_count = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] replication_device = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] report_discard_supported = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] report_interval = 120 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] reservation_clean_interval = 86400 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] reservation_expire = 86400 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] reserved_image_namespaces = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] reserved_percentage = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] rpc_response_timeout = 120 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] run_external_periodic_tasks = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] scst_target_driver = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] scst_target_iqn_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_down_time = 720 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] shell_completion = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] snapshot_name_template = snapshot-%s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] state_path = /opt/stack/data/cinder {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] storage_availability_zone = nova {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] storage_protocol = iSCSI {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] syslog_log_facility = LOG_USER {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] target_helper = lioadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] target_ip_address = 192.168.122.48 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] target_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] target_protocol = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] target_secondary_ip_addresses = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] trace_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] transport_url = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] until_refresh = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_chap_auth = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88013) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 12 07:12:35 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 12 07:12:35 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_default_quota_class = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_journal = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_json = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_stderr = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] use_syslog = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] verify_glance_signatures = enabled {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Running cmd (subprocess): mount.quobyte {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_api_class = cinder.volume.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_backend_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_clear = zero {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_clear_ionice = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_clear_size = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_copy_bps_limit = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_dd_blocksize = 1M {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_name_template = volume-%s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_service_inithost_offload = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volume_usage_audit_period = month {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] zoning_mode = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_concurrency.disable_process_locking = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.auth_type = password {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.auth_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.cache = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.include_service_catalog = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.interface = public {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcache_username = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.region_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.service_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.backend = dogpile.cache.null {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.backend_argument = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.backend_expiration_time = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.config_prefix = cache.oslo {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.debug_cache_backend = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.enable_retry_client = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.enable_socket_keepalive = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.expiration_time = 600 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.hashclient_retry_attempts = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_dead_retry = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_pool_maxsize = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_sasl_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack quobyte-client[88019]: Reading configuration file: /etc/quobyte/client.cfg Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.proxies = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.redis_db = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.redis_server = localhost:6379 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.retry_attempts = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack quobyte-client[88019]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.retry_delay = 0.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.socket_keepalive_count = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.socket_keepalive_idle = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.socket_keepalive_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.socket_timeout = 1.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.tls_allowed_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.tls_cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.tls_certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.tls_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.tls_keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cache.username = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] coordination.backend_url = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.asyncio_connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.asyncio_slave_connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.backend = sqlalchemy {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.connection_debug = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.connection_parameters = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.connection_recycle_time = 3600 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.connection_trace = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.db_inc_retry_interval = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.db_max_retries = 20 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.db_max_retry_interval = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.db_retry_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.max_overflow = 50 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.max_pool_size = 5 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.max_retries = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.mysql_wsrep_sync_wait = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.pool_timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.retry_interval = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.slave_connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.sqlite_synchronous = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.synchronous_reader = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] database.use_db_reconnect = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_tracing.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.connection_string = messaging:// {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.es_doc_type = notification {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.es_scroll_size = 10000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.es_scroll_time = 2m {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.filter_error_trace = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.hmac_keys = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.sentinel_service_name = mymaster {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.socket_timeout = 0.1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.trace_requests = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler.trace_sqlalchemy = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler_jaeger.process_tags = {} {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler_jaeger.service_name_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] profiler_otlp.service_name_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.enforce_new_defaults = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.policy_default_rule = default {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.policy_file = policy.yaml {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.group = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.helper_command = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] privsep_osbrick.user = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.group = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.helper_command = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] cinder_sys_admin.user = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.auth_type = password {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.send_service_user_token = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] service_user.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.auth_type = password {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.region_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] glance.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.backend_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.chap_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.chap_username = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.disk_geometry = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.driver_client_cert = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.driver_client_cert_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.driver_data_namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.driver_use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.extra_capabilities = {} {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.filter_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.goodness_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.iscsi_target_flags = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.iscsi_write_cache = on {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.iser_helper = tgtadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.iser_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_host = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_login = admin {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_mount_options = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_private_key = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_share_path = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.num_shell_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.quobyte_volume_url = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.replication_device = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.report_discard_supported = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.reserved_percentage = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.target_helper = tgtadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.target_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.target_protocol = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.trace_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.unique_fqdn_network = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.use_chap_auth = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_backend_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_clear = zero {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_clear_ionice = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_clear_size = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_reports.file_event_handler = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_reports.log_dir = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.backend_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.backend_host = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.chap_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.chap_username = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.chiscsi_conf = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.disk_geometry = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.driver_client_cert = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.driver_data_namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.driver_use_ssl = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.extra_capabilities = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.filter_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.goodness_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.iser_helper = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.iser_ip_address = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.iser_port = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.iser_target_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_host = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_login = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_mount_options = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_private_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_share_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_ssh_port = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.num_shell_tries = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.nvmet_port_id = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.replication_device = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.report_discard_supported = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.reserved_percentage = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.scst_target_driver = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.storage_protocol = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.target_helper = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.target_ip_address = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.target_port = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.target_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.target_protocol = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.trace_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.use_chap_auth = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_clear = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_clear_size = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] QuobyteHD.volumes_dir = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_notifications.driver = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_notifications.retry = -1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] key_manager.fixed_key = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.barbican_api_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.barbican_endpoint = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.barbican_endpoint_type = public {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.barbican_region_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.number_of_retries = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.retry_delay = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.send_service_user_token = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.verify_ssl = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican.verify_ssl_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.auth_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] barbican_service_user.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.approle_role_id = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.approle_secret_id = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.auth_method = approle {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.auth_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.kv_mountpoint = secret {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.kv_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.kv_version = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.root_token_id = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.ssl_ca_crt_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.timeout = 60.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.token_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.token_role = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 12 07:12:35 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-466a53af-e9ce-46fb-80ce-375005828113 None None] ******************************************************************************** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 12 07:12:35 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.232s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:35 devstack cinder-volume[88013]: INFO cinder.volume.driver [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Driver hasn't implemented _init_vendor_properties() Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.driver [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1816902160645, 'free_capacity_gb': 1773.1816902160645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88013) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_db.sqlalchemy.engines [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writer thread running {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.db.api [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Building query based on filter {{(pid=88013) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88013) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:35 devstack cinder-volume[88013]: INFO cinder.keymgr.migration [None req-ce7625a0-a383-4e79-a891-068245499e24 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 12 07:12:35 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:35 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:35 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:35 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:12:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Driver initialization completed successfully. Sep 12 07:12:36 devstack cinder-volume[88013]: INFO cinder.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Initiating service 3 cleanup Sep 12 07:12:36 devstack cinder-volume[88013]: INFO cinder.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Service 3 cleanup completed. Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG cinder.service [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Creating RPC server for service cinder-volume {{(pid=88013) start /opt/stack/cinder/cinder/service.py:231}} Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG cinder.service [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88013) start /opt/stack/cinder/cinder/service.py:237}} Sep 12 07:12:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:12:36 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:12:36 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:12:36 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Sep 12 07:12:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:12:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2d33f587-4486-4461-a853-2bf51fdc9e60 None None] Driver post RPC initialization completed successfully. Sep 12 07:12:45 devstack cinder-volume[87725]: DEBUG dbcounter [-] [87725] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:12:46 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:12:46 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=3 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:13:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:13:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 6 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:13:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Flow 'volume_create_manager' (413116ee-ca6e-498f-bfcb-cab570954e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4efaa00-1bbb-4d84-ae9b-70abcd9decb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4efaa00-1bbb-4d84-ae9b-70abcd9decb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1425781100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03cc1a3-6f98-4943-b095-0e4e26960a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b16986cc3a4a8f8c0be77abc15e36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:13:46Z,use_quota=True,user_id='546b2595ebe8400b982fbf8c9fafc967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf388b-b371-48ef-a973-e649b0bff068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf388b-b371-48ef-a973-e649b0bff068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810e7ce1-a621-4c7f-909b-42f48416c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810e7ce1-a621-4c7f-909b-42f48416c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03cc1a3-6f98-4943-b095-0e4e26960a73', 'volume_name': 'volume-f03cc1a3-6f98-4943-b095-0e4e26960a73', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef53086-6afb-4a29-951a-caaf076bbf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef53086-6afb-4a29-951a-caaf076bbf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4208e24-c72f-4840-9373-9bf142ccae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Volume f03cc1a3-6f98-4943-b095-0e4e26960a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03cc1a3-6f98-4943-b095-0e4e26960a73', 'volume_size': 1} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1425781100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03cc1a3-6f98-4943-b095-0e4e26960a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b16986cc3a4a8f8c0be77abc15e36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:13:46Z,use_quota=True,user_id='546b2595ebe8400b982fbf8c9fafc967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Creating volume f03cc1a3-6f98-4943-b095-0e4e26960a73 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:13:46 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:13:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:13:46 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 1073741824 Sep 12 07:13:46 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:13:48 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Sep 12 07:13:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 1073741824" returned: 0 in 1.703s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:13:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:13:48 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 Sep 12 07:13:48 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:13:49 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73" returned: 0 in 0.982s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] <== create_volume: return (2928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.941s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4208e24-c72f-4840-9373-9bf142ccae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03cc1a3-6f98-4943-b095-0e4e26960a73', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7bfd66-4a91-4d70-9379-2432cbba0911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Volume volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 (f03cc1a3-6f98-4943-b095-0e4e26960a73): created successfully Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7bfd66-4a91-4d70-9379-2432cbba0911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Flow 'volume_create_manager' (413116ee-ca6e-498f-bfcb-cab570954e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:13:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6868f1d4-be21-406b-9ab6-b552da74ea7c tempest-DeleteServersTestJSON-231104587 None] Created volume successfully. Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Flow 'volume_create_manager' (bf1cdfbf-9e7a-45e4-a85e-6d9d2fa362a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9b95cd-250f-4952-963f-519435fec7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9b95cd-250f-4952-963f-519435fec7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1554488541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41099e1c-8e27-49d9-bce9-b918e4b80d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e76c912e0643c28d730a752ae9f676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:13:50Z,use_quota=True,user_id='d2eed5eef2a54745aba7bdd88cc2e3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5800b711-df78-4ddf-aa40-2d66b076bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5800b711-df78-4ddf-aa40-2d66b076bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77389761-d4e1-4f22-9c05-6e2ebbd290a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77389761-d4e1-4f22-9c05-6e2ebbd290a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41099e1c-8e27-49d9-bce9-b918e4b80d45', 'volume_name': 'volume-41099e1c-8e27-49d9-bce9-b918e4b80d45', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970a29bd-ed54-4d2e-90f9-be636e2b4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970a29bd-ed54-4d2e-90f9-be636e2b4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd20b49c-1128-4c78-924c-929c002a5afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:50 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Volume 41099e1c-8e27-49d9-bce9-b918e4b80d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41099e1c-8e27-49d9-bce9-b918e4b80d45', 'volume_size': 1} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1554488541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41099e1c-8e27-49d9-bce9-b918e4b80d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e76c912e0643c28d730a752ae9f676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:13:50Z,use_quota=True,user_id='d2eed5eef2a54745aba7bdd88cc2e3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Creating volume 41099e1c-8e27-49d9-bce9-b918e4b80d45 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:13:50 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:13:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:13:50 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 1073741824 Sep 12 07:13:50 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:13:51 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Sep 12 07:13:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 1073741824" returned: 0 in 0.993s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:13:52 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 Sep 12 07:13:52 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:13:52 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45" returned: 0 in 0.630s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd20b49c-1128-4c78-924c-929c002a5afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41099e1c-8e27-49d9-bce9-b918e4b80d45', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbe8a09-256a-4836-947d-e70c81cc950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:13:52 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Volume volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 (41099e1c-8e27-49d9-bce9-b918e4b80d45): created successfully Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbe8a09-256a-4836-947d-e70c81cc950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:13:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Flow 'volume_create_manager' (bf1cdfbf-9e7a-45e4-a85e-6d9d2fa362a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:13:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bda256fd-ee94-48d2-a343-14b655f4527b tempest-VolumesAdminNegativeTest-1401721952 None] Created volume successfully. Sep 12 07:13:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Acquiring lock "cinder-41099e1c-8e27-49d9-bce9-b918e4b80d45-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:13:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Lock "cinder-41099e1c-8e27-49d9-bce9-b918e4b80d45-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:13:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Acquiring lock "cinder-quobyte-41099e1c-8e27-49d9-bce9-b918e4b80d45" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:13:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Lock "cinder-quobyte-41099e1c-8e27-49d9-bce9-b918e4b80d45" acquired by "delete_volume" :: waited 0.048s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:13:55 devstack cinder-volume[88013]: INFO oslo.privsep.daemon [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbt3d8yml/privsep.sock'] Sep 12 07:13:55 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbt3d8yml/privsep.sock Sep 12 07:13:55 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 12 07:13:58 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Sep 12 07:13:58 devstack cinder-volume[88013]: WARNING py.warnings [req-67894ec9-57e2-4e71-ad7d-6a0c416c8461 req-e869e20a-fad3-4d54-8f77-d62fbf9a8a15 tempest-DeleteServersTestJSON-231104587 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 12 07:13:58 devstack cinder-volume[88013]: .first() Sep 12 07:13:58 devstack cinder-volume[88013]: Sep 12 07:13:58 devstack cinder-volume[88013]: INFO oslo.privsep.daemon [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Spawned new privsep daemon via rootwrap Sep 12 07:13:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Accepted privsep connection to /tmp/tmpbt3d8yml/privsep.sock {{(pid=88013) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 12 07:13:58 devstack cinder-volume[88013]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 12 07:13:58 devstack cinder-volume[88013]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 12 07:13:58 devstack cinder-volume[88013]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 12 07:13:58 devstack cinder-volume[88013]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89192 Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa93e75-afff-406b-a651-94dfafee0459]: (2,) {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-67894ec9-57e2-4e71-ad7d-6a0c416c8461 req-e869e20a-fad3-4d54-8f77-d62fbf9a8a15 tempest-DeleteServersTestJSON-231104587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-67894ec9-57e2-4e71-ad7d-6a0c416c8461 req-e869e20a-fad3-4d54-8f77-d62fbf9a8a15 tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c73686-e113-4824-b28c-7ff16a7a4184]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-67894ec9-57e2-4e71-ad7d-6a0c416c8461 req-e869e20a-fad3-4d54-8f77-d62fbf9a8a15 tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:13:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-67894ec9-57e2-4e71-ad7d-6a0c416c8461 req-e869e20a-fad3-4d54-8f77-d62fbf9a8a15 tempest-DeleteServersTestJSON-231104587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-f03cc1a3-6f98-4943-b095-0e4e26960a73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cecde3c-5c89-4e62-8045-8897b6efa5ac', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:13:59 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 Sep 12 07:13:59 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:13:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-67894ec9-57e2-4e71-ad7d-6a0c416c8461 req-e869e20a-fad3-4d54-8f77-d62fbf9a8a15 tempest-DeleteServersTestJSON-231104587 None] attachment_update completed successfully. Sep 12 07:14:00 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45" returned: 0 in 0.986s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:00 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45 Sep 12 07:14:00 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:00 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-41099e1c-8e27-49d9-bce9-b918e4b80d45" returned: 0 in 0.669s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Lock "cinder-quobyte-41099e1c-8e27-49d9-bce9-b918e4b80d45" released by "delete_volume" :: held 5.448s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:01 devstack cinder-volume[88013]: WARNING cinder.quota [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:14:01 devstack cinder-volume[88013]: WARNING cinder.quota [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Created reservations ['cc3a5404-caf2-4e83-84ef-937b8d946b50', '4504ad29-883f-41e4-8808-99a37ac4d303', '463be1be-5102-49b8-8b9a-2271a1ffaa1d', '6630744e-5902-4aad-8b92-2deb8326fb62'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:01 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:14:01 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:02 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.653s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:02 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:14:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Deleted volume successfully. Sep 12 07:14:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ad5c9a20-3b2d-499e-931c-121d0bf2f032 tempest-VolumesAdminNegativeTest-1401721952 None] Lock "cinder-41099e1c-8e27-49d9-bce9-b918e4b80d45-delete_volume" released by "delete_volume" :: held 7.060s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-d764ef37-735d-46da-8de5-b673fd17de76 req-fbdf6b24-d222-4ef5-864d-81f2f0fb1916 tempest-DeleteServersTestJSON-231104587 None] Terminate volume connection completed successfully. Sep 12 07:14:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-d764ef37-735d-46da-8de5-b673fd17de76 req-fbdf6b24-d222-4ef5-864d-81f2f0fb1916 tempest-DeleteServersTestJSON-231104587 None] Deleting attachment 2cecde3c-5c89-4e62-8045-8897b6efa5ac. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:14:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Acquiring lock "cinder-f03cc1a3-6f98-4943-b095-0e4e26960a73-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:14:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Lock "cinder-f03cc1a3-6f98-4943-b095-0e4e26960a73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:14:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Acquiring lock "cinder-quobyte-f03cc1a3-6f98-4943-b095-0e4e26960a73" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:14:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Lock "cinder-quobyte-f03cc1a3-6f98-4943-b095-0e4e26960a73" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:14:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d932e-53a3-4153-a28a-e6fd9509e979]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:14:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:11 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 Sep 12 07:14:11 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:12 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:12 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73 Sep 12 07:14:12 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:12 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f03cc1a3-6f98-4943-b095-0e4e26960a73" returned: 0 in 0.375s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Lock "cinder-quobyte-f03cc1a3-6f98-4943-b095-0e4e26960a73" released by "delete_volume" :: held 0.830s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Created reservations ['4fe09c3a-05df-4dbe-9a31-4197d0479648', '2670e253-53b7-4af7-8d07-f53e09a3b994', '3b31c094-98d5-4a42-9e00-35dc8d4a357e', '7e1fce9e-8cf2-4545-ae80-f885a9cb4aed'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:12 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:14:12 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:13 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:13 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:14:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Deleted volume successfully. Sep 12 07:14:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3abd33e0-203d-450c-838e-c39f121bd5a9 tempest-DeleteServersTestJSON-231104587 None] Lock "cinder-f03cc1a3-6f98-4943-b095-0e4e26960a73-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Flow 'volume_create_manager' (0243ca76-349f-43c3-8ad7-10a66f6f5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5502dc1c-4a28-4143-8996-6e9e364464ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5502dc1c-4a28-4143-8996-6e9e364464ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1436147396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc05722-d798-4d70-9343-1a741983db1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74e8518609545c1b09be71805e5a1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:14:18Z,use_quota=True,user_id='d85e68ce03cb47a8b412854a68bf2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85cb3b3-8612-4dea-a61f-a9a581ebd89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85cb3b3-8612-4dea-a61f-a9a581ebd89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13dc745-2bb8-454f-9210-a867dcf93cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13dc745-2bb8-454f-9210-a867dcf93cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc05722-d798-4d70-9343-1a741983db1b', 'volume_name': 'volume-9cc05722-d798-4d70-9343-1a741983db1b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707595de-4708-47a8-8a0b-8e9bf6765ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707595de-4708-47a8-8a0b-8e9bf6765ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2ad322-9523-4660-a0ae-dfacecd72de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Volume 9cc05722-d798-4d70-9343-1a741983db1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc05722-d798-4d70-9343-1a741983db1b', 'volume_size': 1} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1436147396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc05722-d798-4d70-9343-1a741983db1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74e8518609545c1b09be71805e5a1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:14:18Z,use_quota=True,user_id='d85e68ce03cb47a8b412854a68bf2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Creating volume 9cc05722-d798-4d70-9343-1a741983db1b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:14:18 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:14:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:18 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b 1073741824 Sep 12 07:14:18 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:19 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b 1073741824" returned: 0 in 0.527s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:19 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b Sep 12 07:14:19 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:19 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b" returned: 0 in 0.304s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2ad322-9523-4660-a0ae-dfacecd72de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc05722-d798-4d70-9343-1a741983db1b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0546beb6-738c-4ab5-b24f-df9600d9c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Volume volume-9cc05722-d798-4d70-9343-1a741983db1b (9cc05722-d798-4d70-9343-1a741983db1b): created successfully Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0546beb6-738c-4ab5-b24f-df9600d9c246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Flow 'volume_create_manager' (0243ca76-349f-43c3-8ad7-10a66f6f5c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:14:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-79619b16-2e23-4fc0-9ab6-e3ad716c200f tempest-ServersNegativeTestJSON-1033300759 None] Created volume successfully. Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Flow 'volume_create_manager' (262602f5-a936-4712-b102-1bdbf0e2b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ab58ab-b3ef-4b3d-932e-09881ef63144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ab58ab-b3ef-4b3d-932e-09881ef63144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1646946939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490735c7-749f-446b-9f5b-85274b299857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74e8518609545c1b09be71805e5a1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:14:23Z,use_quota=True,user_id='d85e68ce03cb47a8b412854a68bf2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f625bf5e-ade5-4b51-944d-ba146bd93998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f625bf5e-ade5-4b51-944d-ba146bd93998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436307b0-2fbb-4df4-949e-6f1c0e2fd27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436307b0-2fbb-4df4-949e-6f1c0e2fd27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '490735c7-749f-446b-9f5b-85274b299857', 'volume_name': 'volume-490735c7-749f-446b-9f5b-85274b299857', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8f5af6-50b8-40f0-9ad8-ab44212f0713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8f5af6-50b8-40f0-9ad8-ab44212f0713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a9a367-10fd-4013-a1c3-ad8580d819b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Volume 490735c7-749f-446b-9f5b-85274b299857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-490735c7-749f-446b-9f5b-85274b299857', 'volume_size': 1} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1646946939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490735c7-749f-446b-9f5b-85274b299857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74e8518609545c1b09be71805e5a1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:14:23Z,use_quota=True,user_id='d85e68ce03cb47a8b412854a68bf2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Creating volume 490735c7-749f-446b-9f5b-85274b299857 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:14:23 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:23 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 1073741824 Sep 12 07:14:23 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:23 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 1073741824" returned: 0 in 0.503s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:23 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 Sep 12 07:14:23 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:23 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857" returned: 0 in 0.302s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a9a367-10fd-4013-a1c3-ad8580d819b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490735c7-749f-446b-9f5b-85274b299857', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fa5b95-cbda-49a6-a894-61a234a72899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:24 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Volume volume-490735c7-749f-446b-9f5b-85274b299857 (490735c7-749f-446b-9f5b-85274b299857): created successfully Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fa5b95-cbda-49a6-a894-61a234a72899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Flow 'volume_create_manager' (262602f5-a936-4712-b102-1bdbf0e2b013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:14:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-05632b8d-65a7-4cb0-8f90-eccf41ccccdf tempest-ServersNegativeTestJSON-1033300759 None] Created volume successfully. Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "cinder-490735c7-749f-446b-9f5b-85274b299857-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-490735c7-749f-446b-9f5b-85274b299857-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "cinder-quobyte-490735c7-749f-446b-9f5b-85274b299857" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-quobyte-490735c7-749f-446b-9f5b-85274b299857" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a14d424-2258-43ff-9c1f-6d5cbec5f8db]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:28 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 Sep 12 07:14:28 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:28 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857" returned: 0 in 0.368s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:28 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857 Sep 12 07:14:28 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:29 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-490735c7-749f-446b-9f5b-85274b299857" returned: 0 in 0.261s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-quobyte-490735c7-749f-446b-9f5b-85274b299857" released by "delete_volume" :: held 0.682s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Created reservations ['e7ba225d-048f-4c67-9677-2bfa623b7d1d', '460c9b69-ac29-4248-8460-5e55b9078525', '2a5c41a9-0b02-4035-b14b-e30d549c1cdb', '3252de2a-33e5-4d0c-a19c-68502cc72734'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:29 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:14:29 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "cinder-9cc05722-d798-4d70-9343-1a741983db1b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:14:29 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.322s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:14:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Deleted volume successfully. Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-9cc05722-d798-4d70-9343-1a741983db1b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4924c107-6b80-4f20-b8c2-730e5fd4c3e0 tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-490735c7-749f-446b-9f5b-85274b299857-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "cinder-quobyte-9cc05722-d798-4d70-9343-1a741983db1b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-quobyte-9cc05722-d798-4d70-9343-1a741983db1b" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d175bd-858a-4363-bab8-9ddf7fab2054]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:14:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:30 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b Sep 12 07:14:30 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:30 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b" returned: 0 in 0.412s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:30 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b Sep 12 07:14:30 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:30 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:14:30 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:30 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:30 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9cc05722-d798-4d70-9343-1a741983db1b" returned: 0 in 0.333s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.302s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-quobyte-9cc05722-d798-4d70-9343-1a741983db1b" released by "delete_volume" :: held 0.797s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 8 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Created reservations ['668eb58e-cdee-4bfb-a3c0-77fa33d0e19b', '80321e3c-3b32-48f8-97d3-798bf194e670', 'a331d2be-c28a-41e4-b16f-3d15e4e9a20e', '43288e71-2f3b-4cb0-9348-fde2552b07ec'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:30 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:14:30 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:31 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.304s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:14:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Deleted volume successfully. Sep 12 07:14:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-deaf5412-38ed-46d7-b105-b769723e12bd tempest-ServersNegativeTestJSON-1033300759 None] Lock "cinder-9cc05722-d798-4d70-9343-1a741983db1b-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:14:36 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:DELETE=4,cinder:INSERT=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:14:46 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=38,cinder:UPDATE=45,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Flow 'volume_create_manager' (5cd309c5-de38-45af-b2bf-472e512ae9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5a32d2-ba3f-4e8e-9a47-4f3e8e2af9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5a32d2-ba3f-4e8e-9a47-4f3e8e2af9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-396412865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4276b18-5636-4928-bb31-d3d9d0e45c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d059f506fa4403ba4ec8ec9cb76fd16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:14:54Z,use_quota=True,user_id='dd56b1b3e98f47139b486adfb08fa58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca74818b-1218-43a3-abf2-0922a4aee873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca74818b-1218-43a3-abf2-0922a4aee873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abd8fe8-d1e7-4a1f-bd98-f67c7ea18278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abd8fe8-d1e7-4a1f-bd98-f67c7ea18278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4276b18-5636-4928-bb31-d3d9d0e45c24', 'volume_name': 'volume-c4276b18-5636-4928-bb31-d3d9d0e45c24', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5b9fa2-12f4-4be2-beaa-e4f266cc9f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5b9fa2-12f4-4be2-beaa-e4f266cc9f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2006969e-6c15-46b4-b460-b7382e3e69a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:53 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Volume c4276b18-5636-4928-bb31-d3d9d0e45c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4276b18-5636-4928-bb31-d3d9d0e45c24', 'volume_size': 1} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-396412865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4276b18-5636-4928-bb31-d3d9d0e45c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d059f506fa4403ba4ec8ec9cb76fd16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:14:54Z,use_quota=True,user_id='dd56b1b3e98f47139b486adfb08fa58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Creating volume c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:14:53 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:14:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:53 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 1073741824 Sep 12 07:14:53 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:54 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 1073741824" returned: 0 in 0.565s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:54 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 Sep 12 07:14:54 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:54 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24" returned: 0 in 0.373s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2006969e-6c15-46b4-b460-b7382e3e69a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4276b18-5636-4928-bb31-d3d9d0e45c24', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff0b449-a99d-4517-90fe-c3aa8ef52a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:14:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Volume volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 (c4276b18-5636-4928-bb31-d3d9d0e45c24): created successfully Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff0b449-a99d-4517-90fe-c3aa8ef52a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:14:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Flow 'volume_create_manager' (5cd309c5-de38-45af-b2bf-472e512ae9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:14:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-14c78ecf-2fb0-4a78-9f93-cd84383e7100 req-cae7e7f6-48d9-4fd7-a6ca-953541d7b6c2 tempest-VolumesSnapshotsTestJSON-1165944118 None] Created volume successfully. Sep 12 07:14:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:14:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:14:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Creating offline snapshot 0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 of volume c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:14:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b59a27-5d87-4050-9985-829cb7e450b5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:14:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:57 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 Sep 12 07:14:57 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:58 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24" returned: 0 in 0.884s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:58 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 1G Sep 12 07:14:58 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:14:59 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Sep 12 07:14:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 1G" returned: 0 in 0.938s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:14:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:14:59 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 Sep 12 07:14:59 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:00 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" returned: 0 in 0.565s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:00 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 is being set with open permissions: ugo+rw Sep 12 07:15:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:00 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 Sep 12 07:15:00 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:00 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" returned: 0 in 0.438s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:00 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info Sep 12 07:15:00 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:01 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info" returned: 0 in 0.523s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:01 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info is being set with open permissions: ugo+rw Sep 12 07:15:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:01 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info Sep 12 07:15:01 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:01 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.info" returned: 0 in 0.430s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-6807c0c0-dae2-45a0-a9ad-e219dd671f2b req-86f380de-3c9e-4675-ac59-687656375246 tempest-VolumesSnapshotsTestJSON-1165944118 None] Create snapshot completed successfully Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "cinder-0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "cinder-quobyte-c4276b18-5636-4928-bb31-d3d9d0e45c24" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-quobyte-c4276b18-5636-4928-bb31-d3d9d0e45c24" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "cinder-quobyte-0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-quobyte-0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Deleting offline snapshot 0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 of volume c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] snapshot_file for this snap is: volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb01d35c-6ead-4396-806e-8af3237ecabe]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:15:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:02 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 Sep 12 07:15:02 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:03 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" returned: 0 in 1.115s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4276b18-5636-4928-bb31-d3d9d0e45c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:15:03 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bf4ee4-6d23-4eb1-8e89-af46487891ab]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:15:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:03 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 Sep 12 07:15:03 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:04 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24" returned: 0 in 0.774s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:04 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 Sep 12 07:15:04 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:05 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" returned: 0 in 1.107s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:05 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0 Sep 12 07:15:05 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:06 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24.0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" returned: 0 in 0.673s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-quobyte-0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0" released by "_delete_snapshot" :: held 3.957s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-quobyte-c4276b18-5636-4928-bb31-d3d9d0e45c24" released by "delete_snapshot" :: held 4.036s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:06 devstack cinder-volume[88013]: WARNING cinder.quota [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:15:06 devstack cinder-volume[88013]: DEBUG cinder.quota [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Created reservations ['b4d029f0-0415-407b-8f3a-97e0a6fd772b', '2475dc21-c034-45f2-b8c5-887ff857243d', '7908e159-dc73-4c10-abdc-70dd93747005', '1a2777ba-fcef-4509-9e13-bb792f898246'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:15:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Delete snapshot completed successfully. Sep 12 07:15:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-81d6bb43-fc00-477f-93e4-032f7bffab29 req-1b223207-0dd6-43ff-8ad8-9a27d36ecc3c tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-0c0bcb3d-43e1-4ccb-bafd-112ddec57ac0-delete_snapshot" released by "delete_snapshot" :: held 4.308s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "cinder-c4276b18-5636-4928-bb31-d3d9d0e45c24-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-c4276b18-5636-4928-bb31-d3d9d0e45c24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "cinder-quobyte-c4276b18-5636-4928-bb31-d3d9d0e45c24" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-quobyte-c4276b18-5636-4928-bb31-d3d9d0e45c24" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[99727b9f-436f-40ce-bb61-ebf5eb1274a1]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:07 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 Sep 12 07:15:07 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:07 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24" returned: 0 in 0.590s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:07 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24 Sep 12 07:15:07 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:08 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c4276b18-5636-4928-bb31-d3d9d0e45c24" returned: 0 in 0.380s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-quobyte-c4276b18-5636-4928-bb31-d3d9d0e45c24" released by "delete_volume" :: held 1.116s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG cinder.quota [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Created reservations ['79357123-85fe-4d46-9c28-da07d5923d2f', '818b69f6-7c7f-4c0f-b6c0-4e2b61ef0bce', 'af3cabcf-abff-410d-865f-dc79842ede9b', '90a12395-67e4-4d51-b419-1279ab867223'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:08 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:15:08 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:09 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:09 devstack cinder-volume[88013]: DEBUG cinder.manager [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:15:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Deleted volume successfully. Sep 12 07:15:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-ac63f7e3-cada-4ed2-8894-42e41f6f6e92 req-4c90cc13-1e8f-476e-8597-ac9d6a2bae91 tempest-VolumesSnapshotsTestJSON-1165944118 None] Lock "cinder-c4276b18-5636-4928-bb31-d3d9d0e45c24-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Flow 'volume_create_manager' (7ad12b1f-9a69-4671-b787-c90b9949374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d7a71c-cd9e-4b0b-a563-41f12e10ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d7a71c-cd9e-4b0b-a563-41f12e10ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-712278589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aaf0925-dfcd-4e47-b535-3a0aa8ba0290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494bbfe218684478af1b2c4c64ab0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:15:15Z,use_quota=True,user_id='a87c5f1fb0a244e7badf2a03252980be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2db72cb-3038-44ba-9745-ca2a0fd1c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2db72cb-3038-44ba-9745-ca2a0fd1c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16b297e-6d6a-4ed1-8e8e-5ad66ad33e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16b297e-6d6a-4ed1-8e8e-5ad66ad33e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aaf0925-dfcd-4e47-b535-3a0aa8ba0290', 'volume_name': 'volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02118de-98c3-4d55-b242-e4a1b8f2353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02118de-98c3-4d55-b242-e4a1b8f2353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ee9fc3-cefe-4391-a433-981a5ab1f4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Volume 2aaf0925-dfcd-4e47-b535-3a0aa8ba0290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290', 'volume_size': 1} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-712278589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aaf0925-dfcd-4e47-b535-3a0aa8ba0290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494bbfe218684478af1b2c4c64ab0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:15:15Z,use_quota=True,user_id='a87c5f1fb0a244e7badf2a03252980be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Creating volume 2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:15:15 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:15:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:15 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 1073741824 Sep 12 07:15:15 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:16 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 1073741824" returned: 0 in 1.007s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:16 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 Sep 12 07:15:16 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:16 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ee9fc3-cefe-4391-a433-981a5ab1f4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df79675-9185-4975-9481-d0b372443f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Volume volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 (2aaf0925-dfcd-4e47-b535-3a0aa8ba0290): created successfully Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df79675-9185-4975-9481-d0b372443f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Flow 'volume_create_manager' (7ad12b1f-9a69-4671-b787-c90b9949374a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:15:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-64264a62-4149-4302-a565-33c9baa395ab tempest-ServerRescueNegativeTestJSON-748534210 None] Created volume successfully. Sep 12 07:15:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f3914f-ef31-4e6a-8c07-f188f6147437 tempest-BackendsCapabilitiesAdminTestsJSON-308586244 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1816902160645, 'free_capacity_gb': 1773.1816902160645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88013) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 12 07:15:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3ad6fbc-03e4-4ad7-85f4-24cfa766a8de tempest-BackendsCapabilitiesAdminTestsJSON-308586244 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1816902160645, 'free_capacity_gb': 1773.1816902160645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88013) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 12 07:15:26 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=21,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:15:26 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=4 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Flow 'volume_create_manager' (fc28fa8f-782a-4264-b301-ceb933db334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69da62f6-8284-4747-97e6-054c52a6330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69da62f6-8284-4747-97e6-054c52a6330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-679008567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8895e563-a6b2-4481-8609-2347fa41f65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce95503f09914402892201304b21dc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:15:27Z,use_quota=True,user_id='4d23e6c10c854a8cb8c9db426cadc183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7e4774-8f54-45ac-b89a-fb0196055deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7e4774-8f54-45ac-b89a-fb0196055deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81acf496-df19-4d08-b941-0dbb96ebe1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81acf496-df19-4d08-b941-0dbb96ebe1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8895e563-a6b2-4481-8609-2347fa41f65c', 'volume_name': 'volume-8895e563-a6b2-4481-8609-2347fa41f65c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8b8f75-206b-4359-890f-a127ab70e9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8b8f75-206b-4359-890f-a127ab70e9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3d2cb8-edc6-4b7c-8645-9b6099502c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:27 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Volume 8895e563-a6b2-4481-8609-2347fa41f65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8895e563-a6b2-4481-8609-2347fa41f65c', 'volume_size': 1} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-679008567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8895e563-a6b2-4481-8609-2347fa41f65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce95503f09914402892201304b21dc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:15:27Z,use_quota=True,user_id='4d23e6c10c854a8cb8c9db426cadc183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Creating volume 8895e563-a6b2-4481-8609-2347fa41f65c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:15:27 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:27 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c 1073741824 Sep 12 07:15:27 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:27 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c 1073741824" returned: 0 in 0.710s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:27 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c Sep 12 07:15:27 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:28 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c" returned: 0 in 0.292s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3d2cb8-edc6-4b7c-8645-9b6099502c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8895e563-a6b2-4481-8609-2347fa41f65c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4415d7-1f84-4811-8e36-dbe41d4842cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:28 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Volume volume-8895e563-a6b2-4481-8609-2347fa41f65c (8895e563-a6b2-4481-8609-2347fa41f65c): created successfully Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4415d7-1f84-4811-8e36-dbe41d4842cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Flow 'volume_create_manager' (fc28fa8f-782a-4264-b301-ceb933db334c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:15:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cbb7381e-69fe-4aa7-aa63-c50beb924ddd tempest-TaggedAttachmentsTest-64063953 None] Created volume successfully. Sep 12 07:15:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Acquiring lock "cinder-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "cinder-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Acquiring lock "cinder-quobyte-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:15:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "cinder-quobyte-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:15:29 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf01832-2b2c-434a-af1b-80cf9c3dabf3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:15:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:29 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 Sep 12 07:15:29 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:30 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290" returned: 0 in 0.546s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:30 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290 Sep 12 07:15:30 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:30 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:15:30 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:30 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.532s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:15:30 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290" returned: 0 in 0.681s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "cinder-quobyte-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290" released by "delete_volume" :: held 1.329s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Created reservations ['332164f2-7661-4d89-b097-eb3d9466751e', '2e4b5706-581e-44c4-9f8f-70933f8061df', '36497942-d865-403d-a628-5d6ac379a27a', '2b140ee4-9d05-4cdb-9437-3353c7240e73'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Flow 'volume_create_manager' (114c8468-8c42-4e09-91a2-e411b7756a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e685d1f-f757-4a2e-96e6-a91d5804d8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e685d1f-f757-4a2e-96e6-a91d5804d8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-554084756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed70cf1-8911-4bfa-9e20-8b96a6104386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c33bc0bf7b49fb8c38c2f5a4c79a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:15:31Z,use_quota=True,user_id='7020122021f64bcf96372a0d829545fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ce85ed-637f-43b5-9f46-8ddf7bf5a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ce85ed-637f-43b5-9f46-8ddf7bf5a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0055dd31-db8d-419f-8ff7-53bbbcb48f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0055dd31-db8d-419f-8ff7-53bbbcb48f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed70cf1-8911-4bfa-9e20-8b96a6104386', 'volume_name': 'volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20438e63-5ff8-4f2d-8583-7f47863bcb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20438e63-5ff8-4f2d-8583-7f47863bcb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfefdc8-a85a-4de1-a99d-f5e569f12b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:31 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Volume 1ed70cf1-8911-4bfa-9e20-8b96a6104386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386', 'volume_size': 1} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-554084756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed70cf1-8911-4bfa-9e20-8b96a6104386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c33bc0bf7b49fb8c38c2f5a4c79a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:15:31Z,use_quota=True,user_id='7020122021f64bcf96372a0d829545fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Creating volume 1ed70cf1-8911-4bfa-9e20-8b96a6104386 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:15:31 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:31 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 1073741824 Sep 12 07:15:31 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:31 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:15:31 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:31 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.385s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:15:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Deleted volume successfully. Sep 12 07:15:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd015b22-27b9-4878-9d34-4d33da2cc78a tempest-ServerRescueNegativeTestJSON-748534210 None] Lock "cinder-2aaf0925-dfcd-4e47-b535-3a0aa8ba0290-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:15:32 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 1073741824" returned: 0 in 0.890s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:15:32 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 Sep 12 07:15:32 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:15:32 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386" returned: 0 in 0.615s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfefdc8-a85a-4de1-a99d-f5e569f12b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770293d2-c29a-4463-acdd-6600e57d3c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:15:33 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Volume volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 (1ed70cf1-8911-4bfa-9e20-8b96a6104386): created successfully Sep 12 07:15:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770293d2-c29a-4463-acdd-6600e57d3c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:15:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Flow 'volume_create_manager' (114c8468-8c42-4e09-91a2-e411b7756a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:15:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4919960b-1cfc-4c55-ad8f-8e596f120922 tempest-AttachVolumeShelveTestJSON-318372192 None] Created volume successfully. Sep 12 07:15:43 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:15:43 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=17,cinder:INSERT=4,cinder:SELECT=8,cinder:DELETE=2 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:15:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-eb43b8ba-5f54-4266-842c-47f7c335c4e8 req-84037850-4316-4eb7-8d60-711ac1bdc17b tempest-AttachVolumeShelveTestJSON-318372192 None] No connector for attachment 18efa805-0850-4a3b-98f9-2e6e09bdd4dc; skipping storage backend terminate_connection call. {{(pid=88013) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 12 07:15:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-eb43b8ba-5f54-4266-842c-47f7c335c4e8 req-84037850-4316-4eb7-8d60-711ac1bdc17b tempest-AttachVolumeShelveTestJSON-318372192 None] Deleting attachment 18efa805-0850-4a3b-98f9-2e6e09bdd4dc. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:15:59 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:15:59 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Flow 'volume_create_manager' (096909f5-21cf-47f4-b104-e48f54de6b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd3b30f-b78c-46b9-ad51-8292d5dde6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd3b30f-b78c-46b9-ad51-8292d5dde6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1154088241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84e7061-d966-4fee-a137-f540fc7dcea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81376968f7ee440cb51a6927bdfc6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:09Z,use_quota=True,user_id='5883cf60ecb640008da334ccd13f0336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0847cc53-c01e-4e53-b5a8-1e27bcfa58b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0847cc53-c01e-4e53-b5a8-1e27bcfa58b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2857cbc-97fb-4370-bb02-74ae5e8df7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2857cbc-97fb-4370-bb02-74ae5e8df7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84e7061-d966-4fee-a137-f540fc7dcea2', 'volume_name': 'volume-a84e7061-d966-4fee-a137-f540fc7dcea2', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31350f38-41d2-47d9-9b49-4a91fbd677e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31350f38-41d2-47d9-9b49-4a91fbd677e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8259586-5ad8-42bb-96f6-ee6b80d6a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Volume a84e7061-d966-4fee-a137-f540fc7dcea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84e7061-d966-4fee-a137-f540fc7dcea2', 'volume_size': 1} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1154088241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84e7061-d966-4fee-a137-f540fc7dcea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81376968f7ee440cb51a6927bdfc6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:09Z,use_quota=True,user_id='5883cf60ecb640008da334ccd13f0336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Creating volume a84e7061-d966-4fee-a137-f540fc7dcea2 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:16:09 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:16:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:09 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 1073741824 Sep 12 07:16:09 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:10 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 1073741824" returned: 0 in 0.645s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:10 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 Sep 12 07:16:10 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:10 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8259586-5ad8-42bb-96f6-ee6b80d6a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84e7061-d966-4fee-a137-f540fc7dcea2', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7516ebe5-e9ee-4fff-b8d5-83d6395d93df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Volume volume-a84e7061-d966-4fee-a137-f540fc7dcea2 (a84e7061-d966-4fee-a137-f540fc7dcea2): created successfully Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7516ebe5-e9ee-4fff-b8d5-83d6395d93df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Flow 'volume_create_manager' (096909f5-21cf-47f4-b104-e48f54de6b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3fc46b88-22fb-4260-9e16-402c7c6da49b tempest-VolumeQuotasAdminTestJSON-119293124 None] Created volume successfully. Sep 12 07:16:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "cinder-a84e7061-d966-4fee-a137-f540fc7dcea2-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "cinder-a84e7061-d966-4fee-a137-f540fc7dcea2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "cinder-quobyte-a84e7061-d966-4fee-a137-f540fc7dcea2" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "cinder-quobyte-a84e7061-d966-4fee-a137-f540fc7dcea2" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea64a52d-69f3-4ee2-b40d-72f1de358530]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:12 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 Sep 12 07:16:12 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:13 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2" returned: 0 in 0.858s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:13 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2 Sep 12 07:16:13 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:13 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a84e7061-d966-4fee-a137-f540fc7dcea2" returned: 0 in 0.619s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "cinder-quobyte-a84e7061-d966-4fee-a137-f540fc7dcea2" released by "delete_volume" :: held 1.575s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Created reservations ['e9dc8d88-c7ea-469a-af50-0d55266145c8', 'c03b74b2-bfee-419d-b122-8048e4af7d89', '310850c9-4895-43e1-94a0-7d8845300da4', 'd0888219-f47e-4de8-bc2f-4a837f7da0f2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:13 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:16:13 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:14 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.329s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:16:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Deleted volume successfully. Sep 12 07:16:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-31e8333a-f2ac-4052-8978-ed83f1b122a9 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "cinder-a84e7061-d966-4fee-a137-f540fc7dcea2-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Flow 'volume_create_manager' (d6cd0f36-af16-4d63-8eea-16d63d46a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e574072f-fd04-4171-b953-e3db87840193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e574072f-fd04-4171-b953-e3db87840193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1055182226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbbf377-51bc-4de1-a1bd-e84c05233d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81376968f7ee440cb51a6927bdfc6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:16Z,use_quota=True,user_id='5883cf60ecb640008da334ccd13f0336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63711894-3d5f-407e-bd92-88ab66b9e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63711894-3d5f-407e-bd92-88ab66b9e32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9df609b-f820-4691-84d4-41c44f7d3e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9df609b-f820-4691-84d4-41c44f7d3e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cbbf377-51bc-4de1-a1bd-e84c05233d3c', 'volume_name': 'volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2727fb1-b41e-487b-8f0d-702acdbb71cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2727fb1-b41e-487b-8f0d-702acdbb71cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8eabad-b3ae-4a25-b28c-312a60891615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Volume 0cbbf377-51bc-4de1-a1bd-e84c05233d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c', 'volume_size': 1} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1055182226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbbf377-51bc-4de1-a1bd-e84c05233d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81376968f7ee440cb51a6927bdfc6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:16Z,use_quota=True,user_id='5883cf60ecb640008da334ccd13f0336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Creating volume 0cbbf377-51bc-4de1-a1bd-e84c05233d3c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:16:15 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:16:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:15 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c 1073741824 Sep 12 07:16:15 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:17 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c 1073741824" returned: 0 in 1.524s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:17 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c Sep 12 07:16:17 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:18 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c" returned: 0 in 0.694s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8eabad-b3ae-4a25-b28c-312a60891615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68655fb6-411f-45d0-9499-50488cf55e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Volume volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c (0cbbf377-51bc-4de1-a1bd-e84c05233d3c): created successfully Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68655fb6-411f-45d0-9499-50488cf55e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Flow 'volume_create_manager' (d6cd0f36-af16-4d63-8eea-16d63d46a010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-be4c9baf-835d-41e7-9fad-9f78d5637132 tempest-VolumeQuotasAdminTestJSON-119293124 None] Created volume successfully. Sep 12 07:16:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-c82df0eb-fde9-429e-9c8b-7e618426a92d req-8a0c145f-7ce0-4300-ba28-4ee390a32afe tempest-TaggedAttachmentsTest-64063953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-c82df0eb-fde9-429e-9c8b-7e618426a92d req-8a0c145f-7ce0-4300-ba28-4ee390a32afe tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-c82df0eb-fde9-429e-9c8b-7e618426a92d req-8a0c145f-7ce0-4300-ba28-4ee390a32afe tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-c82df0eb-fde9-429e-9c8b-7e618426a92d req-8a0c145f-7ce0-4300-ba28-4ee390a32afe tempest-TaggedAttachmentsTest-64063953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-8895e563-a6b2-4481-8609-2347fa41f65c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bdfa8eb-517a-403d-aa25-a1a116a12609', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:16:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-c82df0eb-fde9-429e-9c8b-7e618426a92d req-8a0c145f-7ce0-4300-ba28-4ee390a32afe tempest-TaggedAttachmentsTest-64063953 None] attachment_update completed successfully. Sep 12 07:16:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1f626944-73b9-44f7-bb4d-fe11b29f7cca tempest-VolumeQuotasAdminTestJSON-1582464402 None] Transfer volume completed successfully. Sep 12 07:16:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Acquiring lock "cinder-0cbbf377-51bc-4de1-a1bd-e84c05233d3c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Lock "cinder-0cbbf377-51bc-4de1-a1bd-e84c05233d3c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Acquiring lock "cinder-quobyte-0cbbf377-51bc-4de1-a1bd-e84c05233d3c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Lock "cinder-quobyte-0cbbf377-51bc-4de1-a1bd-e84c05233d3c" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[815d9758-08b4-414b-a5e1-59db5cfbbab0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:22 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c Sep 12 07:16:22 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:22 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c" returned: 0 in 0.516s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:22 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c Sep 12 07:16:22 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:23 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0cbbf377-51bc-4de1-a1bd-e84c05233d3c" returned: 0 in 0.393s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Lock "cinder-quobyte-0cbbf377-51bc-4de1-a1bd-e84c05233d3c" released by "delete_volume" :: held 0.963s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Created reservations ['1aa90b8d-00a5-4f5c-a661-5db56e34a621', '1165a9a7-f17e-41da-a7c6-d3a6068de568', '885c4c35-5f19-4e3b-9408-eaa815f80fcb', '9302ca23-b45b-40d8-ac89-ccc4c77a1905'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:23 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:16:23 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:23 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:16:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Deleted volume successfully. Sep 12 07:16:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f62446e1-1be0-4425-b986-1f47f8890aed tempest-VolumeQuotasAdminTestJSON-1812478557 None] Lock "cinder-0cbbf377-51bc-4de1-a1bd-e84c05233d3c-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-69940ecf-d268-406e-8096-cd030ede1bb3 req-562886bd-f354-4637-baf6-40effb74e122 tempest-TaggedAttachmentsTest-64063953 None] Terminate volume connection completed successfully. Sep 12 07:16:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-69940ecf-d268-406e-8096-cd030ede1bb3 req-562886bd-f354-4637-baf6-40effb74e122 tempest-TaggedAttachmentsTest-64063953 None] Deleting attachment 8bdfa8eb-517a-403d-aa25-a1a116a12609. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:30 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:16:30 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:30 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.393s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 8 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:16:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=19,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=5 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=3 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Acquiring lock "cinder-8895e563-a6b2-4481-8609-2347fa41f65c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Lock "cinder-8895e563-a6b2-4481-8609-2347fa41f65c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Acquiring lock "cinder-quobyte-8895e563-a6b2-4481-8609-2347fa41f65c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Lock "cinder-quobyte-8895e563-a6b2-4481-8609-2347fa41f65c" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[361dd154-82d0-4d50-be04-41580e5add94]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:34 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c Sep 12 07:16:34 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:35 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:35 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c Sep 12 07:16:35 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:35 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8895e563-a6b2-4481-8609-2347fa41f65c" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Lock "cinder-quobyte-8895e563-a6b2-4481-8609-2347fa41f65c" released by "delete_volume" :: held 0.655s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Created reservations ['50c79cef-1ab1-448f-b6c1-cb0e619b3729', '930899f0-9c03-4387-9e95-d31c31f42b0c', '74dd9e28-97bd-4073-93bc-51910e5782c2', '41e1de43-86c5-4b6c-bef0-e00bb1e7b99d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:35 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:16:35 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:35 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.267s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:16:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Deleted volume successfully. Sep 12 07:16:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c101ee7-8f29-46c1-bbe9-baf68602d732 tempest-TaggedAttachmentsTest-64063953 None] Lock "cinder-8895e563-a6b2-4481-8609-2347fa41f65c-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Flow 'volume_create_manager' (b789e780-e5bd-4a32-9e51-c051b4df3ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d1162b-c2ef-4912-b409-497b2c250d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d1162b-c2ef-4912-b409-497b2c250d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-779834990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6b74306675463db494550d1e2ab50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:40Z,use_quota=True,user_id='99c61bb089924db8a1bc3bd6f8fb36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf673e0a-6316-4c26-b094-f69eeaf217a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf673e0a-6316-4c26-b094-f69eeaf217a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3707ac-2cb9-4e6a-82e4-93d4e4f645ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3707ac-2cb9-4e6a-82e4-93d4e4f645ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07', 'volume_name': 'volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1b8af5-1372-4dd5-b6c9-d9f69a5a701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1b8af5-1372-4dd5-b6c9-d9f69a5a701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d82436-9903-4a49-a4e1-997d4035a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:40 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Volume 1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07', 'volume_size': 1} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-779834990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6b74306675463db494550d1e2ab50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:40Z,use_quota=True,user_id='99c61bb089924db8a1bc3bd6f8fb36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Creating volume 1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:16:40 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:40 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 1073741824 Sep 12 07:16:40 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:40 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 1073741824" returned: 0 in 0.469s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:40 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 Sep 12 07:16:40 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:41 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" returned: 0 in 0.311s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d82436-9903-4a49-a4e1-997d4035a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e5380-9a18-466f-bb5c-05754bc08f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:41 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Volume volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 (1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07): created successfully Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e5380-9a18-466f-bb5c-05754bc08f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Flow 'volume_create_manager' (b789e780-e5bd-4a32-9e51-c051b4df3ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-33e0f287-c65c-4980-ab55-dab96c19bd69 tempest-SnapshotMetadataTestJSON-1786980301 None] Created volume successfully. Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Creating offline snapshot 39b399e5-d817-40fb-8dae-69fc2bfe9bc6 of volume 1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1dce6e-9e5f-455b-a566-a1d4f4673421]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:42 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 Sep 12 07:16:42 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:42 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" returned: 0 in 0.405s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:42 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 1G Sep 12 07:16:42 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:43 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 1G" returned: 0 in 0.508s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:43 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 Sep 12 07:16:43 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:43 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6" returned: 0 in 0.538s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:44 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 is being set with open permissions: ugo+rw Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:44 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 Sep 12 07:16:44 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:44 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6" returned: 0 in 0.378s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:44 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info Sep 12 07:16:44 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:16:44 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Flow 'volume_create_manager' (52028cc3-cbbf-4789-9d83-8f1f6d4cf46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf50fcc-c1da-4772-a2b9-91c659b25e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:44 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info is being set with open permissions: ugo+rw Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf50fcc-c1da-4772-a2b9-91c659b25e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1907871685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea87f55-511a-42c2-a4f2-008014aa8446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460ea0a101304d60a1b6d910dce3dfcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:45Z,use_quota=True,user_id='04011a4bfe334e2b989675e81263ebd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a819b0-c93b-47e7-b1cf-c1f7159cb29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:44 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info Sep 12 07:16:44 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a819b0-c93b-47e7-b1cf-c1f7159cb29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476d5fbf-9ef7-4967-ad0b-5d017b47cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476d5fbf-9ef7-4967-ad0b-5d017b47cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea87f55-511a-42c2-a4f2-008014aa8446', 'volume_name': 'volume-bea87f55-511a-42c2-a4f2-008014aa8446', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1a72bf-2456-48d6-80f7-837364484c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1a72bf-2456-48d6-80f7-837364484c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3ac7cd-13a7-451c-b5f6-00dad3a5f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Volume bea87f55-511a-42c2-a4f2-008014aa8446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea87f55-511a-42c2-a4f2-008014aa8446', 'volume_size': 1} Sep 12 07:16:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:45 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.info" returned: 0 in 0.312s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1907871685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea87f55-511a-42c2-a4f2-008014aa8446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460ea0a101304d60a1b6d910dce3dfcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:16:45Z,use_quota=True,user_id='04011a4bfe334e2b989675e81263ebd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Creating volume bea87f55-511a-42c2-a4f2-008014aa8446 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:16:45 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:45 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 1073741824 Sep 12 07:16:45 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:45 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4f92765b-f126-47d8-afd3-a84d87b0bec8 tempest-SnapshotMetadataTestJSON-1786980301 None] Create snapshot completed successfully Sep 12 07:16:45 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 1073741824" returned: 0 in 0.565s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:45 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 Sep 12 07:16:45 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:46 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446" returned: 0 in 0.274s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3ac7cd-13a7-451c-b5f6-00dad3a5f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea87f55-511a-42c2-a4f2-008014aa8446', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912051cf-0db2-4924-b457-9a86a1ce8d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:16:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Volume volume-bea87f55-511a-42c2-a4f2-008014aa8446 (bea87f55-511a-42c2-a4f2-008014aa8446): created successfully Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912051cf-0db2-4924-b457-9a86a1ce8d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Flow 'volume_create_manager' (52028cc3-cbbf-4789-9d83-8f1f6d4cf46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:16:46 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-dbc79839-63d2-4aa3-bfe2-6e88faf741fc tempest-AttachVolumeTestJSON-380067606 None] Created volume successfully. Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "cinder-39b399e5-d817-40fb-8dae-69fc2bfe9bc6-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-39b399e5-d817-40fb-8dae-69fc2bfe9bc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "cinder-quobyte-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-quobyte-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "cinder-quobyte-39b399e5-d817-40fb-8dae-69fc2bfe9bc6" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-quobyte-39b399e5-d817-40fb-8dae-69fc2bfe9bc6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Deleting offline snapshot 39b399e5-d817-40fb-8dae-69fc2bfe9bc6 of volume 1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] snapshot_file for this snap is: volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb61c070-6e14-4428-822d-4e07d993949a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:47 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 Sep 12 07:16:47 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:47 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6" returned: 0 in 0.599s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb799e7-bedf-4c83-926c-7195b112a0dd]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:47 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 Sep 12 07:16:47 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-9fda2147-ce3c-485a-adf7-79588d4cde01 req-b4c39d68-898a-4922-a867-568fc0b6e98c tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-9fda2147-ce3c-485a-adf7-79588d4cde01 req-b4c39d68-898a-4922-a867-568fc0b6e98c tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-9fda2147-ce3c-485a-adf7-79588d4cde01 req-b4c39d68-898a-4922-a867-568fc0b6e98c tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-9fda2147-ce3c-485a-adf7-79588d4cde01 req-b4c39d68-898a-4922-a867-568fc0b6e98c tempest-AttachVolumeTestJSON-380067606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-bea87f55-511a-42c2-a4f2-008014aa8446', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52cf8826-8878-4777-a650-d9a5d77fb9f3', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:16:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-9fda2147-ce3c-485a-adf7-79588d4cde01 req-b4c39d68-898a-4922-a867-568fc0b6e98c tempest-AttachVolumeTestJSON-380067606 None] attachment_update completed successfully. Sep 12 07:16:47 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" returned: 0 in 0.437s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:48 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 Sep 12 07:16:48 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:48 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6" returned: 0 in 0.420s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:48 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6 Sep 12 07:16:48 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:48 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07.39b399e5-d817-40fb-8dae-69fc2bfe9bc6" returned: 0 in 0.379s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-quobyte-39b399e5-d817-40fb-8dae-69fc2bfe9bc6" released by "_delete_snapshot" :: held 1.984s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-quobyte-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" released by "delete_snapshot" :: held 2.019s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:48 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Created reservations ['d8126979-94f1-47fe-b47b-e5efba24a3f4', '755edb57-4fe0-4d1c-9b3b-d4aa8cc71b5d', '00e403b0-5e6a-4d4c-9c23-1b522f453a0c', 'cc41c2bd-12d1-483e-b6b0-6831a531ce6e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:16:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Delete snapshot completed successfully. Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f4b7ca3b-4b64-4302-972f-bac351e20c10 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-39b399e5-d817-40fb-8dae-69fc2bfe9bc6-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Acquiring lock "cinder-1ed70cf1-8911-4bfa-9e20-8b96a6104386-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "cinder-1ed70cf1-8911-4bfa-9e20-8b96a6104386-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Acquiring lock "cinder-quobyte-1ed70cf1-8911-4bfa-9e20-8b96a6104386" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "cinder-quobyte-1ed70cf1-8911-4bfa-9e20-8b96a6104386" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9df51-56d1-4104-b17e-dd0ac594816d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:49 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 Sep 12 07:16:49 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:50 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386" returned: 0 in 0.530s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:50 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386 Sep 12 07:16:50 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "cinder-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "cinder-quobyte-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-quobyte-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a429c-ee4f-499f-afae-44ab28650da3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:50 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ed70cf1-8911-4bfa-9e20-8b96a6104386" returned: 0 in 0.418s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "cinder-quobyte-1ed70cf1-8911-4bfa-9e20-8b96a6104386" released by "delete_volume" :: held 0.996s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:50 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 Sep 12 07:16:50 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Created reservations ['55023527-75c5-4538-a41f-dcec81cf65c5', '4006259c-33f7-4527-9080-ecf4efb175e2', 'f3d41f34-c89c-4d32-ad7e-f1a5c00c2723', '9017fd60-b6eb-4595-a769-9d2f97cbe9ca'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:50 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:16:50 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:50 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" returned: 0 in 0.494s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:50 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07 Sep 12 07:16:50 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:50 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.279s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:50 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:16:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Deleted volume successfully. Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-79547cc1-ac1e-42b4-9b3a-42fc2a571e66 tempest-AttachVolumeShelveTestJSON-318372192 None] Lock "cinder-1ed70cf1-8911-4bfa-9e20-8b96a6104386-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:51 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-quobyte-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07" released by "delete_volume" :: held 0.825s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Created reservations ['476899d0-065c-4912-afd0-d5165b662558', '14415288-2441-4229-a903-6ac8f3ff04e4', '578498e3-165e-454f-a9a0-ffe4380f3cb0', '7cdc8be5-53fc-470b-b7f0-bfbb8f3c295d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:16:51 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:16:51 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:16:51 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.374s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:16:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Deleted volume successfully. Sep 12 07:16:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f6a62f8-e8cb-4ff3-9ed0-f3e1a70cdd75 tempest-SnapshotMetadataTestJSON-1786980301 None] Lock "cinder-1ec5ddf1-ce31-48d7-bade-af9a1a9e2d07-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:01 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=4 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:17:01 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=36,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=2 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Flow 'volume_create_manager' (2d5038f3-7fc3-48b2-9b3c-620818355b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8b6c0f-c675-47cb-bdb9-2894def39a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8b6c0f-c675-47cb-bdb9-2894def39a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1709219984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf6e457-08e0-40d0-be80-d2039d33f238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311edf1c19674486b3a14222073377a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:05Z,use_quota=True,user_id='46ede30a707942bcb7f9c39e3062cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e85dd8-7afb-44fd-b059-a10da155b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e85dd8-7afb-44fd-b059-a10da155b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9335cdf-144c-478d-899f-d0edc59acc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9335cdf-144c-478d-899f-d0edc59acc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf6e457-08e0-40d0-be80-d2039d33f238', 'volume_name': 'volume-8bf6e457-08e0-40d0-be80-d2039d33f238', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31963d6-5f27-4d5e-beb2-8dbf93bfbad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31963d6-5f27-4d5e-beb2-8dbf93bfbad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623ad853-3310-47d8-8053-5730ff68d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Volume 8bf6e457-08e0-40d0-be80-d2039d33f238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf6e457-08e0-40d0-be80-d2039d33f238', 'volume_size': 1} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1709219984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf6e457-08e0-40d0-be80-d2039d33f238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311edf1c19674486b3a14222073377a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:05Z,use_quota=True,user_id='46ede30a707942bcb7f9c39e3062cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Creating volume 8bf6e457-08e0-40d0-be80-d2039d33f238 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:05 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:05 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 1073741824 Sep 12 07:17:05 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Flow 'volume_create_manager' (d5b243f4-e1bf-4a08-b68b-9d2141af2d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cd3875-69c8-42c4-8c7b-0dd891624102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cd3875-69c8-42c4-8c7b-0dd891624102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1225258135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03eacd62-500b-45a0-b837-1c4daf8dc675,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='671bd6612f50478893f1cc1961856d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:05Z,use_quota=True,user_id='116df88cbaea4fbbac0c02f602d8327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947dac95-d4a2-4d70-9bda-2a387f68344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947dac95-d4a2-4d70-9bda-2a387f68344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b0f6f7-cea1-48bb-9365-de5a9e340189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b0f6f7-cea1-48bb-9365-de5a9e340189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03eacd62-500b-45a0-b837-1c4daf8dc675', 'volume_name': 'volume-03eacd62-500b-45a0-b837-1c4daf8dc675', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d631e3a-9341-4a7b-a3df-857de18927c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d631e3a-9341-4a7b-a3df-857de18927c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7d362a-9d54-49be-9d40-e16d449baed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Volume 03eacd62-500b-45a0-b837-1c4daf8dc675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03eacd62-500b-45a0-b837-1c4daf8dc675', 'volume_size': 1} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:05 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 1073741824" returned: 0 in 0.584s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:05 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 Sep 12 07:17:05 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:06 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1225258135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03eacd62-500b-45a0-b837-1c4daf8dc675,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='671bd6612f50478893f1cc1961856d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:05Z,use_quota=True,user_id='116df88cbaea4fbbac0c02f602d8327c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Creating volume 03eacd62-500b-45a0-b837-1c4daf8dc675 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:06 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623ad853-3310-47d8-8053-5730ff68d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf6e457-08e0-40d0-be80-d2039d33f238', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2bf551-d9a2-408a-a842-9eafe23b6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:06 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 1073741824 Sep 12 07:17:06 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Volume volume-8bf6e457-08e0-40d0-be80-d2039d33f238 (8bf6e457-08e0-40d0-be80-d2039d33f238): created successfully Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2bf551-d9a2-408a-a842-9eafe23b6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Flow 'volume_create_manager' (2d5038f3-7fc3-48b2-9b3c-620818355b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c62bbd75-4228-48f6-aa55-19b4ec6d91be tempest-VolumesTransfersTest-1263344793 None] Created volume successfully. Sep 12 07:17:06 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 1073741824" returned: 0 in 0.483s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:06 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 Sep 12 07:17:06 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:06 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7d362a-9d54-49be-9d40-e16d449baed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03eacd62-500b-45a0-b837-1c4daf8dc675', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb8b509-844e-4467-8e78-91ffb7e28f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Volume volume-03eacd62-500b-45a0-b837-1c4daf8dc675 (03eacd62-500b-45a0-b837-1c4daf8dc675): created successfully Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb8b509-844e-4467-8e78-91ffb7e28f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Flow 'volume_create_manager' (d5b243f4-e1bf-4a08-b68b-9d2141af2d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-519b9d7a-11b7-4117-91c0-5a97fadc4c28 req-6d7bf519-d16a-44b8-b491-fd126bdd4a46 tempest-VolumesGetTestJSON-1287947713 None] Created volume successfully. Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Acquiring lock "cinder-03eacd62-500b-45a0-b837-1c4daf8dc675-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Lock "cinder-03eacd62-500b-45a0-b837-1c4daf8dc675-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Acquiring lock "cinder-quobyte-03eacd62-500b-45a0-b837-1c4daf8dc675" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Lock "cinder-quobyte-03eacd62-500b-45a0-b837-1c4daf8dc675" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea360c-b99d-4bad-bb8a-5a79d7955c86]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:07 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 Sep 12 07:17:07 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:07 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675" returned: 0 in 0.432s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:08 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675 Sep 12 07:17:08 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a3d10718-cc40-4442-aed8-53b4ed4d0611 tempest-VolumesTransfersTest-2121427884 None] Transfer volume completed successfully. Sep 12 07:17:08 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-03eacd62-500b-45a0-b837-1c4daf8dc675" returned: 0 in 0.402s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Lock "cinder-quobyte-03eacd62-500b-45a0-b837-1c4daf8dc675" released by "delete_volume" :: held 0.912s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG cinder.quota [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Created reservations ['fb6ab4b0-422a-49d7-8bdf-7cdf76224a56', 'f08b6b56-30fb-41ec-b2c1-072bc40b321e', 'cca97230-50b0-479c-9e9f-851b0c010d40', '4e267064-af16-4a8e-b18b-7c5fb39c6b91'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:08 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:08 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Acquiring lock "cinder-8bf6e457-08e0-40d0-be80-d2039d33f238-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-8bf6e457-08e0-40d0-be80-d2039d33f238-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:09 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.453s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG cinder.manager [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Deleted volume successfully. Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Acquiring lock "cinder-quobyte-8bf6e457-08e0-40d0-be80-d2039d33f238" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-70bc5e13-abd5-4f51-943d-0d2cdb2e6c04 req-2ee9e0d9-a2ea-4ac1-8b0a-931e375e0b42 tempest-VolumesGetTestJSON-1287947713 None] Lock "cinder-03eacd62-500b-45a0-b837-1c4daf8dc675-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-quobyte-8bf6e457-08e0-40d0-be80-d2039d33f238" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b933b9-49c4-4332-bc0d-28d7d7a97b15]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:09 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 Sep 12 07:17:09 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:09 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238" returned: 0 in 0.465s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:09 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238 Sep 12 07:17:09 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:10 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8bf6e457-08e0-40d0-be80-d2039d33f238" returned: 0 in 0.397s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-quobyte-8bf6e457-08e0-40d0-be80-d2039d33f238" released by "delete_volume" :: held 0.945s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Created reservations ['5cb41a41-443e-4d1e-94dd-a3c9214b78bb', 'fa5d8af0-cbbc-45be-9ce8-919f0a26c06c', 'cbe39bbc-5f8a-4b6e-a7e9-ca08f48066bb', '6953a7db-35bf-456d-a728-2dd494368c37'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:10 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:10 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:10 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.389s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Deleted volume successfully. Sep 12 07:17:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4a05eebb-f4ef-4b14-8baa-4cee28412646 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-8bf6e457-08e0-40d0-be80-d2039d33f238-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Flow 'volume_create_manager' (3f3f31e5-e568-4a7a-bec9-e2c094b30c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aaac7a-fa6e-4f2f-a692-07e47c5b588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aaac7a-fa6e-4f2f-a692-07e47c5b588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1660398273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2a324-31c2-441c-849d-efcdd3f82c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311edf1c19674486b3a14222073377a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:12Z,use_quota=True,user_id='46ede30a707942bcb7f9c39e3062cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36772835-94c5-4856-90a2-ee8b5d9f4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36772835-94c5-4856-90a2-ee8b5d9f4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0209720-c542-4417-bcce-8db88e51f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0209720-c542-4417-bcce-8db88e51f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d2a324-31c2-441c-849d-efcdd3f82c49', 'volume_name': 'volume-80d2a324-31c2-441c-849d-efcdd3f82c49', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f47c48-a164-4baf-a055-a26b9a6eca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f47c48-a164-4baf-a055-a26b9a6eca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a3c494-e644-4c2e-a88c-40fbeea3f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:12 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Volume 80d2a324-31c2-441c-849d-efcdd3f82c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d2a324-31c2-441c-849d-efcdd3f82c49', 'volume_size': 1} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1660398273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2a324-31c2-441c-849d-efcdd3f82c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311edf1c19674486b3a14222073377a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:12Z,use_quota=True,user_id='46ede30a707942bcb7f9c39e3062cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Creating volume 80d2a324-31c2-441c-849d-efcdd3f82c49 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:12 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:12 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 1073741824 Sep 12 07:17:12 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:12 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 1073741824" returned: 0 in 0.530s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:12 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 Sep 12 07:17:12 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:13 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a3c494-e644-4c2e-a88c-40fbeea3f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d2a324-31c2-441c-849d-efcdd3f82c49', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f170b3df-4c8e-40f9-8472-f975fc6e2d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:13 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Volume volume-80d2a324-31c2-441c-849d-efcdd3f82c49 (80d2a324-31c2-441c-849d-efcdd3f82c49): created successfully Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f170b3df-4c8e-40f9-8472-f975fc6e2d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Flow 'volume_create_manager' (3f3f31e5-e568-4a7a-bec9-e2c094b30c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-dd68e84e-bd03-412c-ab38-6d89c98ba4f7 tempest-VolumesTransfersTest-1263344793 None] Created volume successfully. Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Flow 'volume_create_manager' (e2a4f7aa-a1d2-4155-8d05-44b6df4991f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9584367-74fe-4e18-9a09-e23d25ec05c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9584367-74fe-4e18-9a09-e23d25ec05c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446807411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c81e05-8e17-44a6-a9be-9a47b565a1d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a917d403768457eba789f74de4bb081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:15Z,use_quota=True,user_id='5e45928df8bf4b6e8056c64589b9fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9aea325-7b5f-4e64-a368-54ea373657b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9aea325-7b5f-4e64-a368-54ea373657b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093f761c-4180-44f3-8d22-abf2b958aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093f761c-4180-44f3-8d22-abf2b958aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c81e05-8e17-44a6-a9be-9a47b565a1d9', 'volume_name': 'volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495a1db5-32ba-41c9-9872-217638b9df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495a1db5-32ba-41c9-9872-217638b9df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d02ec6a-2287-4cd5-98a5-a069e5aa667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:14 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Volume 93c81e05-8e17-44a6-a9be-9a47b565a1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9', 'volume_size': 1} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446807411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c81e05-8e17-44a6-a9be-9a47b565a1d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a917d403768457eba789f74de4bb081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:15Z,use_quota=True,user_id='5e45928df8bf4b6e8056c64589b9fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Creating volume 93c81e05-8e17-44a6-a9be-9a47b565a1d9 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:14 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Acquiring lock "cinder-80d2a324-31c2-441c-849d-efcdd3f82c49-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:14 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 1073741824 Sep 12 07:17:14 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-80d2a324-31c2-441c-849d-efcdd3f82c49-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Acquiring lock "cinder-quobyte-80d2a324-31c2-441c-849d-efcdd3f82c49" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-quobyte-80d2a324-31c2-441c-849d-efcdd3f82c49" acquired by "delete_volume" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c0df7-c966-4921-8799-1f4657f5ec99]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:15 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 Sep 12 07:17:15 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:15 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 1073741824" returned: 0 in 1.188s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:16 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 Sep 12 07:17:16 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:16 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49" returned: 0 in 0.985s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:16 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49 Sep 12 07:17:16 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:16 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9" returned: 0 in 0.424s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d02ec6a-2287-4cd5-98a5-a069e5aa667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae41e83-a6a5-4f15-9184-641c37244cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Volume volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 (93c81e05-8e17-44a6-a9be-9a47b565a1d9): created successfully Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae41e83-a6a5-4f15-9184-641c37244cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Flow 'volume_create_manager' (e2a4f7aa-a1d2-4155-8d05-44b6df4991f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-47d2e2e5-b023-40ee-b041-88bdef9b515b tempest-VolumesTestJSON-1559421126 None] Created volume successfully. Sep 12 07:17:16 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-80d2a324-31c2-441c-849d-efcdd3f82c49" returned: 0 in 0.442s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-quobyte-80d2a324-31c2-441c-849d-efcdd3f82c49" released by "delete_volume" :: held 1.509s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Created reservations ['fd364593-2584-4198-9a16-7d9dfae97156', 'b03babb5-2b68-4c8f-bc21-725601109f16', 'efad1e5f-c124-4e12-ac64-bc95e0a4aa7e', 'ee6ea0a6-8753-42db-ad18-9e1c0ebc876d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:16 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:16 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:17 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Deleted volume successfully. Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6cc475f5-294b-454f-b104-5f6a4a751d22 tempest-VolumesTransfersTest-573654347 None] Lock "cinder-80d2a324-31c2-441c-849d-efcdd3f82c49-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Flow 'volume_create_manager' (c7ef0abd-9c44-4a32-b41e-8ab5cbc23096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b34cdbf-e4b4-4d1d-8242-a71c86cf3d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b34cdbf-e4b4-4d1d-8242-a71c86cf3d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-262915187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adb4f67-1886-4d42-9b55-6faf7781ff37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a917d403768457eba789f74de4bb081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:18Z,use_quota=True,user_id='5e45928df8bf4b6e8056c64589b9fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb36282-9f83-4c2a-821e-2aceb2c10cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb36282-9f83-4c2a-821e-2aceb2c10cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e55d43-2daf-44e9-822b-43727cec76af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e55d43-2daf-44e9-822b-43727cec76af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7adb4f67-1886-4d42-9b55-6faf7781ff37', 'volume_name': 'volume-7adb4f67-1886-4d42-9b55-6faf7781ff37', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb6cd64-024b-4c24-a3ab-55c41926e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb6cd64-024b-4c24-a3ab-55c41926e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704b736f-6fa8-484d-a21d-1f2e034b8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Volume 7adb4f67-1886-4d42-9b55-6faf7781ff37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7adb4f67-1886-4d42-9b55-6faf7781ff37', 'volume_size': 1} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-262915187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adb4f67-1886-4d42-9b55-6faf7781ff37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a917d403768457eba789f74de4bb081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:18Z,use_quota=True,user_id='5e45928df8bf4b6e8056c64589b9fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Creating volume 7adb4f67-1886-4d42-9b55-6faf7781ff37 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:17 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:17 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 1073741824 Sep 12 07:17:17 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:18 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 1073741824" returned: 0 in 0.527s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:18 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 Sep 12 07:17:18 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:18 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37" returned: 0 in 0.334s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704b736f-6fa8-484d-a21d-1f2e034b8f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7adb4f67-1886-4d42-9b55-6faf7781ff37', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcec524d-72eb-4766-9a69-6198c5896d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Volume volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 (7adb4f67-1886-4d42-9b55-6faf7781ff37): created successfully Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcec524d-72eb-4766-9a69-6198c5896d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Flow 'volume_create_manager' (c7ef0abd-9c44-4a32-b41e-8ab5cbc23096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e03a4a99-76d7-456f-bc45-227a97e24ae5 tempest-VolumesTestJSON-1559421126 None] Created volume successfully. Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Flow 'volume_create_manager' (0a4d14a5-64fd-4905-bb42-5fb8927d36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae05f90-a8f1-4faf-bbc5-9086196028f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae05f90-a8f1-4faf-bbc5-9086196028f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1868221550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087c37df-39f6-4a6a-b754-eae1137d80c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a917d403768457eba789f74de4bb081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:21Z,use_quota=True,user_id='5e45928df8bf4b6e8056c64589b9fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db045e9-b77b-4477-a2cc-1a28872fd272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db045e9-b77b-4477-a2cc-1a28872fd272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9e744d-27d6-4184-9b8f-3565109608de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9e744d-27d6-4184-9b8f-3565109608de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087c37df-39f6-4a6a-b754-eae1137d80c8', 'volume_name': 'volume-087c37df-39f6-4a6a-b754-eae1137d80c8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b73ec2-0196-4410-9b17-57dd1ea277d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b73ec2-0196-4410-9b17-57dd1ea277d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16313440-0fc9-49ee-8740-1b3249f49576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:20 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Volume 087c37df-39f6-4a6a-b754-eae1137d80c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087c37df-39f6-4a6a-b754-eae1137d80c8', 'volume_size': 1} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1868221550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087c37df-39f6-4a6a-b754-eae1137d80c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a917d403768457eba789f74de4bb081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:21Z,use_quota=True,user_id='5e45928df8bf4b6e8056c64589b9fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Creating volume 087c37df-39f6-4a6a-b754-eae1137d80c8 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:20 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:20 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 1073741824 Sep 12 07:17:20 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:21 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 1073741824" returned: 0 in 0.508s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:21 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 Sep 12 07:17:21 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:21 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8" returned: 0 in 0.327s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16313440-0fc9-49ee-8740-1b3249f49576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087c37df-39f6-4a6a-b754-eae1137d80c8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bd1bd9-0a6e-4386-8658-ea460f6d9697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Volume volume-087c37df-39f6-4a6a-b754-eae1137d80c8 (087c37df-39f6-4a6a-b754-eae1137d80c8): created successfully Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bd1bd9-0a6e-4386-8658-ea460f6d9697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Flow 'volume_create_manager' (0a4d14a5-64fd-4905-bb42-5fb8927d36e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9ad24fd4-2c00-499a-b1ad-1a28db3bbc78 tempest-VolumesTestJSON-1559421126 None] Created volume successfully. Sep 12 07:17:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "cinder-087c37df-39f6-4a6a-b754-eae1137d80c8-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-087c37df-39f6-4a6a-b754-eae1137d80c8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "cinder-quobyte-087c37df-39f6-4a6a-b754-eae1137d80c8" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-quobyte-087c37df-39f6-4a6a-b754-eae1137d80c8" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87e0e1-89d2-45d1-87ae-abf37bf6fc0a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:24 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 Sep 12 07:17:24 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:24 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8" returned: 0 in 0.480s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:24 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8 Sep 12 07:17:24 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:24 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-087c37df-39f6-4a6a-b754-eae1137d80c8" returned: 0 in 0.311s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-quobyte-087c37df-39f6-4a6a-b754-eae1137d80c8" released by "delete_volume" :: held 0.837s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Created reservations ['c0ba6808-d850-4970-bb8f-63f9a14dd453', '2b4e8d2e-935a-4ab9-8dd8-105690809f8b', '1e26566f-54ff-4b76-9d26-fb25836af84d', 'd707ed0e-e41f-4544-8cdc-d4a9b2f9fba6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:25 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:25 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "cinder-7adb4f67-1886-4d42-9b55-6faf7781ff37-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-7adb4f67-1886-4d42-9b55-6faf7781ff37-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "cinder-quobyte-7adb4f67-1886-4d42-9b55-6faf7781ff37" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-quobyte-7adb4f67-1886-4d42-9b55-6faf7781ff37" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb345a-12bf-46ac-a8a1-83105b60db0f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:25 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.550s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Deleted volume successfully. Sep 12 07:17:25 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 Sep 12 07:17:25 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a9401946-5d6e-4113-a22b-2a19a645f5f4 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-087c37df-39f6-4a6a-b754-eae1137d80c8-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:25 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37" returned: 0 in 0.497s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:25 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37 Sep 12 07:17:25 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:26 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7adb4f67-1886-4d42-9b55-6faf7781ff37" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-quobyte-7adb4f67-1886-4d42-9b55-6faf7781ff37" released by "delete_volume" :: held 0.839s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Created reservations ['fe791f93-ac30-4102-8244-d2cf0de9e496', '534ab8ab-d9c6-433a-b2d5-f3eb1f2146c9', '6fd2367d-70b9-4f16-89bd-9c8721c859fb', '1cff2933-d50c-4abc-abe3-3826e424e3f6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:26 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:26 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "cinder-93c81e05-8e17-44a6-a9be-9a47b565a1d9-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-93c81e05-8e17-44a6-a9be-9a47b565a1d9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "cinder-quobyte-93c81e05-8e17-44a6-a9be-9a47b565a1d9" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-quobyte-93c81e05-8e17-44a6-a9be-9a47b565a1d9" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38036a4-95a9-4182-a6c9-f0951f5dd6ae]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:26 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.342s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:26 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Deleted volume successfully. Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5199000f-024b-4588-9deb-3b87cc9b8819 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-7adb4f67-1886-4d42-9b55-6faf7781ff37-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:26 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 Sep 12 07:17:26 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Flow 'volume_create_manager' (aa708fab-ecf7-4846-8e05-e6949248703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c75387a-b610-4747-a436-f5fd447c5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c75387a-b610-4747-a436-f5fd447c5042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-94175013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0e28b4-f6f7-4551-a548-2cb911f0108f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e7b0fc70f42d48ab90dc36e733ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:27Z,use_quota=True,user_id='3de6581bb84440e6afa337867b58171c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11603a4f-bc93-4d3c-8cc8-ed3018a5052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11603a4f-bc93-4d3c-8cc8-ed3018a5052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351ea223-2988-4f93-86d0-b680784f444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351ea223-2988-4f93-86d0-b680784f444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0e28b4-f6f7-4551-a548-2cb911f0108f', 'volume_name': 'volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d3bc00-92fe-482a-b2de-c48fdaa77f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d3bc00-92fe-482a-b2de-c48fdaa77f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd22ba72-cc5e-42a0-9282-9a930b7c4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:26 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Volume 8e0e28b4-f6f7-4551-a548-2cb911f0108f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f', 'volume_size': 1} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-94175013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0e28b4-f6f7-4551-a548-2cb911f0108f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e7b0fc70f42d48ab90dc36e733ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:27Z,use_quota=True,user_id='3de6581bb84440e6afa337867b58171c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Creating volume 8e0e28b4-f6f7-4551-a548-2cb911f0108f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:26 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:26 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f 1073741824 Sep 12 07:17:26 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:27 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9" returned: 0 in 0.395s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:27 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9 Sep 12 07:17:27 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:27 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-93c81e05-8e17-44a6-a9be-9a47b565a1d9" returned: 0 in 0.268s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-quobyte-93c81e05-8e17-44a6-a9be-9a47b565a1d9" released by "delete_volume" :: held 0.719s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Created reservations ['8695e259-7d51-41c7-989b-c60b8bfff8df', '7dc5fc54-77a8-4ca6-a634-6f17764bafb1', '1e80f69a-52d8-4d4c-bd4a-ea896f3a38a3', '16cf89b8-7138-456b-bdaa-f5d3a8f7fb79'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:27 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f 1073741824" returned: 0 in 0.441s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:27 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:27 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:27 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:27 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:27 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Deleted volume successfully. Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fd188be1-b3b5-430e-b540-992c49779873 tempest-VolumesTestJSON-1559421126 None] Lock "cinder-93c81e05-8e17-44a6-a9be-9a47b565a1d9-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:27 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd22ba72-cc5e-42a0-9282-9a930b7c4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf1c47b-e9b0-4dcf-b2b3-76057a164197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:27 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Volume volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f (8e0e28b4-f6f7-4551-a548-2cb911f0108f): created successfully Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf1c47b-e9b0-4dcf-b2b3-76057a164197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Flow 'volume_create_manager' (aa708fab-ecf7-4846-8e05-e6949248703a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3cc29d1d-a0d2-451f-976d-10bcfb96c5bc tempest-VolumesTransfersV355Test-2073912362 None] Created volume successfully. Sep 12 07:17:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e203c19d-0883-4e45-b60e-95d6595c4590 tempest-VolumesTransfersV355Test-2106371110 None] Transfer volume completed successfully. Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:30 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:30 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Acquiring lock "cinder-8e0e28b4-f6f7-4551-a548-2cb911f0108f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-8e0e28b4-f6f7-4551-a548-2cb911f0108f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Acquiring lock "cinder-quobyte-8e0e28b4-f6f7-4551-a548-2cb911f0108f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-quobyte-8e0e28b4-f6f7-4551-a548-2cb911f0108f" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f81321b-9ecf-471c-90d3-bad6ed539e07]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:30 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.271s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 8 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:17:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:17:30 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f Sep 12 07:17:30 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:31 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f" returned: 0 in 0.378s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:31 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f Sep 12 07:17:31 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:31 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8e0e28b4-f6f7-4551-a548-2cb911f0108f" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-quobyte-8e0e28b4-f6f7-4551-a548-2cb911f0108f" released by "delete_volume" :: held 0.669s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Created reservations ['d4d6c371-4274-4e24-a741-b379b336c8ff', 'cc8d7906-7359-43e3-9459-add1c69ef03b', 'e55479e5-c864-4d4b-a400-81f1f7aa10e5', 'f3defeb0-2461-4987-b561-662a66f8a911'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:31 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:31 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:31 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Deleted volume successfully. Sep 12 07:17:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-348b780a-8005-4834-ba69-bfe7afce0ce1 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-8e0e28b4-f6f7-4551-a548-2cb911f0108f-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Flow 'volume_create_manager' (7c0a5418-8eff-47ba-af7c-c49ba6bfa579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b8c2a4-88eb-4f8e-989a-0a432bee3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b8c2a4-88eb-4f8e-989a-0a432bee3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-348924975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c88ec5-8ca9-4cf3-b426-dec6aa70d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e7b0fc70f42d48ab90dc36e733ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:32Z,use_quota=True,user_id='3de6581bb84440e6afa337867b58171c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c80ac2-00e3-4983-b23f-27e93344c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c80ac2-00e3-4983-b23f-27e93344c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326420ca-fb57-4f9b-ba2f-cbcfa6e62b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326420ca-fb57-4f9b-ba2f-cbcfa6e62b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c88ec5-8ca9-4cf3-b426-dec6aa70d16d', 'volume_name': 'volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc082d2-d95f-4455-b45c-d51070bd2598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc082d2-d95f-4455-b45c-d51070bd2598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613f8046-646f-4b78-a490-15166ec03779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:32 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Volume 53c88ec5-8ca9-4cf3-b426-dec6aa70d16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d', 'volume_size': 1} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-348924975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c88ec5-8ca9-4cf3-b426-dec6aa70d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e7b0fc70f42d48ab90dc36e733ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:32Z,use_quota=True,user_id='3de6581bb84440e6afa337867b58171c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Creating volume 53c88ec5-8ca9-4cf3-b426-dec6aa70d16d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:32 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-430511e4-b805-40c0-af77-2e490de30342 tempest-GroupSnapshotsTest-2085937321 None] Group tempest-GroupSnapshotsTest-Group-1708059602: creating Sep 12 07:17:32 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d 1073741824 Sep 12 07:17:32 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-430511e4-b805-40c0-af77-2e490de30342 tempest-GroupSnapshotsTest-2085937321 None] Group tempest-GroupSnapshotsTest-Group-1708059602: created successfully Sep 12 07:17:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-430511e4-b805-40c0-af77-2e490de30342 tempest-GroupSnapshotsTest-2085937321 None] Create group completed successfully. Sep 12 07:17:32 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d 1073741824" returned: 0 in 0.427s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:32 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d Sep 12 07:17:32 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:33 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d" returned: 0 in 0.252s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613f8046-646f-4b78-a490-15166ec03779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955829e8-70ef-4b3d-8170-458df0315276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:33 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Volume volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d (53c88ec5-8ca9-4cf3-b426-dec6aa70d16d): created successfully Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955829e8-70ef-4b3d-8170-458df0315276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Flow 'volume_create_manager' (7c0a5418-8eff-47ba-af7c-c49ba6bfa579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b320adaf-0ffe-44e3-8cf4-5b9468a85f2e tempest-VolumesTransfersV355Test-2073912362 None] Created volume successfully. Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Acquiring lock "cinder-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Acquiring lock "cinder-quobyte-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-quobyte-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e61647-039b-476a-8113-1c750e1491b8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:33 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d Sep 12 07:17:33 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (d1e2e222-e51b-4d2d-bdcc-80eab743474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce64e62-53aa-4499-842d-82e271286cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce64e62-53aa-4499-842d-82e271286cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1549630157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=709e491a-542b-415d-bbf4-9a17475a45ef,host='devstack@QuobyteHD#QuobyteHD',id=bad29929-a810-4419-a2cc-264b763b40a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:34Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21cc9b0f-046a-45cb-895b-b693c59180df),volume_type_id=21cc9b0f-046a-45cb-895b-b693c59180df)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2cb44e-ff18-487b-81de-713f969f9d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2cb44e-ff18-487b-81de-713f969f9d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bfc7f4-70df-403f-ad30-b8ba2583aa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bfc7f4-70df-403f-ad30-b8ba2583aa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad29929-a810-4419-a2cc-264b763b40a5', 'volume_name': 'volume-bad29929-a810-4419-a2cc-264b763b40a5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767401b2-7952-4ee8-afcd-546955c0a068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767401b2-7952-4ee8-afcd-546955c0a068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd2a9d1-d89f-4389-840c-bcfca193b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:34 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Volume bad29929-a810-4419-a2cc-264b763b40a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad29929-a810-4419-a2cc-264b763b40a5', 'volume_size': 1} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=709e491a-542b-415d-bbf4-9a17475a45ef,created_at=2026-09-12T05:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1549630157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=709e491a-542b-415d-bbf4-9a17475a45ef,host='devstack@QuobyteHD#QuobyteHD',id=bad29929-a810-4419-a2cc-264b763b40a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:34Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21cc9b0f-046a-45cb-895b-b693c59180df),volume_type_id=21cc9b0f-046a-45cb-895b-b693c59180df)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Creating volume bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:34 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:34 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d" returned: 0 in 0.405s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:34 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 1073741824 Sep 12 07:17:34 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:34 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d Sep 12 07:17:34 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:34 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-quobyte-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d" released by "delete_volume" :: held 0.698s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Created reservations ['71dcc072-7999-4937-8cd9-af01d7ef1380', '2f12339b-47fd-4092-bff6-13f872b18050', 'bb74a7e2-84b0-4d3d-a9c0-c32c09fc2382', '2f3ce27a-db8b-4e49-8b3c-3da13796d353'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:34 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 1073741824" returned: 0 in 0.438s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:34 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:34 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:34 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 Sep 12 07:17:34 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:34 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Deleted volume successfully. Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-978df729-2a70-4b03-b39d-302c925d5918 tempest-VolumesTransfersV355Test-1373482374 None] Lock "cinder-53c88ec5-8ca9-4cf3-b426-dec6aa70d16d-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:34 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd2a9d1-d89f-4389-840c-bcfca193b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad29929-a810-4419-a2cc-264b763b40a5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76abdee7-fdc0-4bb2-b62e-304b5e6a0c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:34 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Volume volume-bad29929-a810-4419-a2cc-264b763b40a5 (bad29929-a810-4419-a2cc-264b763b40a5): created successfully Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76abdee7-fdc0-4bb2-b62e-304b5e6a0c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (d1e2e222-e51b-4d2d-bdcc-80eab743474e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a3f4ee80-fc01-41ab-92f6-9b1614657ebd tempest-GroupSnapshotsTest-2085937321 None] Created volume successfully. Sep 12 07:17:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] GroupSnapshot dee2d932-d79c-446b-9849-c0b5cbcb5789: creating. Sep 12 07:17:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Group snapshot dee2d932-d79c-446b-9849-c0b5cbcb5789: creating. {{(pid=88013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 12 07:17:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Creating offline snapshot c3ee079d-f5a8-4deb-a817-978148821058 of volume bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:17:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbddbaf8-6eeb-43c9-96c2-4e37647eec5d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:35 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 Sep 12 07:17:35 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:36 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5" returned: 0 in 0.377s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:36 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 1G Sep 12 07:17:36 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:36 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 1G" returned: 0 in 0.486s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad29929-a810-4419-a2cc-264b763b40a5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:36 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad29929-a810-4419-a2cc-264b763b40a5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 Sep 12 07:17:36 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:36 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad29929-a810-4419-a2cc-264b763b40a5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:36 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:17:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:36 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 Sep 12 07:17:36 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:37 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:37 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info Sep 12 07:17:37 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:37 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info" returned: 0 in 0.261s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:37 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:17:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:37 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info Sep 12 07:17:37 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:37 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.info" returned: 0 in 0.255s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-29ba5075-1aec-4a57-9fbd-bcba7586b26f tempest-GroupSnapshotsTest-2085937321 None] group_snapshot dee2d932-d79c-446b-9849-c0b5cbcb5789: created successfully Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-c3ee079d-f5a8-4deb-a817-978148821058-d77980d0-617e-4007-b4ce-2076eb7a8277" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-c3ee079d-f5a8-4deb-a817-978148821058-d77980d0-617e-4007-b4ce-2076eb7a8277" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Creating volume d77980d0-617e-4007-b4ce-2076eb7a8277 from snapshot c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-d77980d0-617e-4007-b4ce-2076eb7a8277" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d77980d0-617e-4007-b4ce-2076eb7a8277" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] snapshot: c3ee079d-f5a8-4deb-a817-978148821058, volume: d77980d0-617e-4007-b4ce-2076eb7a8277, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbdf79b-ec92-4816-aac8-5b12a1cdf868]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:39 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 Sep 12 07:17:39 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:39 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058" returned: 0 in 0.388s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bad29929-a810-4419-a2cc-264b763b40a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce7a9ec-ee67-43a6-9cfb-3baf51672621]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:40 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 Sep 12 07:17:40 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:40 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:17:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:40 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 Sep 12 07:17:40 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Flow 'volume_create_manager' (dfa2f0d9-f935-4216-bca0-e7e44fce81c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203f2deb-b54c-4a94-bb8f-486ba94297ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203f2deb-b54c-4a94-bb8f-486ba94297ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-555090635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a069e668-bd23-4ad1-9008-9a01657685bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec0b261db44414b8b31a4a51b4a9174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:42Z,use_quota=True,user_id='8ceb8e7a26b6447f903c976fbef99bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b732080c-ad0d-4201-ba1e-1651f63e3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b732080c-ad0d-4201-ba1e-1651f63e3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dfcfff-d89f-4d1e-92c3-e26ce2282833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dfcfff-d89f-4d1e-92c3-e26ce2282833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a069e668-bd23-4ad1-9008-9a01657685bc', 'volume_name': 'volume-a069e668-bd23-4ad1-9008-9a01657685bc', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304b2465-4703-41de-a3f6-17d52714eadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304b2465-4703-41de-a3f6-17d52714eadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709503e8-91ad-4a49-bcda-c5fe9bde3e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:41 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Volume a069e668-bd23-4ad1-9008-9a01657685bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a069e668-bd23-4ad1-9008-9a01657685bc', 'volume_size': 1} Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-306cf5b4-f6ef-415d-8106-0428a13156f8 req-5730d7ec-e86c-4fc7-ad9c-8f6f59092a96 tempest-AttachVolumeTestJSON-380067606 None] Terminate volume connection completed successfully. Sep 12 07:17:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-306cf5b4-f6ef-415d-8106-0428a13156f8 req-5730d7ec-e86c-4fc7-ad9c-8f6f59092a96 tempest-AttachVolumeTestJSON-380067606 None] Deleting attachment 52cf8826-8878-4777-a650-d9a5d77fb9f3. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Flow 'volume_create_manager' (e1ba8d45-af34-435c-abff-dce557514488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cf1418-3169-4d06-b0a0-b4b2cb49db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cf1418-3169-4d06-b0a0-b4b2cb49db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-196842251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68696727-2172-4614-8ccf-6135148a6b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72fd4428cb04425a4bc10bdb9cc2fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:42Z,use_quota=True,user_id='6b198348cd8e483691f3de9b65ad04c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c462d-859b-429e-98d2-43eb10bf3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c462d-859b-429e-98d2-43eb10bf3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86c99b7-7bef-48e9-9151-dfc6af426ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86c99b7-7bef-48e9-9151-dfc6af426ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68696727-2172-4614-8ccf-6135148a6b5f', 'volume_name': 'volume-68696727-2172-4614-8ccf-6135148a6b5f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28092953-c647-4c52-994b-b63dba4cd589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28092953-c647-4c52-994b-b63dba4cd589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0449d1-41d3-4481-94b6-b09c50412cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Volume 68696727-2172-4614-8ccf-6135148a6b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68696727-2172-4614-8ccf-6135148a6b5f', 'volume_size': 1} Sep 12 07:17:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:46 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277" returned: 0 in 6.035s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:17:46 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Converted 1024.00 MB image at 169.66 MB/s Sep 12 07:17:46 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:46 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 Sep 12 07:17:46 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:46 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277" returned: 0 in 0.292s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d77980d0-617e-4007-b4ce-2076eb7a8277" released by "_copy_volume_from_snapshot" :: held 7.257s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-c3ee079d-f5a8-4deb-a817-978148821058-d77980d0-617e-4007-b4ce-2076eb7a8277" released by "_create_volume_from_snapshot" :: held 7.351s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.373s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.962s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-555090635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a069e668-bd23-4ad1-9008-9a01657685bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec0b261db44414b8b31a4a51b4a9174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:42Z,use_quota=True,user_id='8ceb8e7a26b6447f903c976fbef99bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Creating volume a069e668-bd23-4ad1-9008-9a01657685bc {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:46 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:46 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc 1073741824 Sep 12 07:17:46 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cbaab7a6-0524-48b2-a1b4-080ede10de41 tempest-GroupSnapshotsTest-2085937321 None] Create group from source-snapshot-dee2d932-d79c-446b-9849-c0b5cbcb5789 completed successfully. Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc 1073741824" returned: 0 in 0.510s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:47 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:47 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc Sep 12 07:17:47 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:47 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc" returned: 0 in 0.499s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-196842251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68696727-2172-4614-8ccf-6135148a6b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72fd4428cb04425a4bc10bdb9cc2fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:42Z,use_quota=True,user_id='6b198348cd8e483691f3de9b65ad04c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:17:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Creating volume 68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:17:48 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709503e8-91ad-4a49-bcda-c5fe9bde3e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a069e668-bd23-4ad1-9008-9a01657685bc', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:48 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f 1073741824 Sep 12 07:17:48 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a19534d-e2f5-4208-88e6-915f7ddc75b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Volume volume-a069e668-bd23-4ad1-9008-9a01657685bc (a069e668-bd23-4ad1-9008-9a01657685bc): created successfully Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a19534d-e2f5-4208-88e6-915f7ddc75b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Flow 'volume_create_manager' (dfa2f0d9-f935-4216-bca0-e7e44fce81c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-34ca1112-e41d-438d-9810-a9d10b3657e7 tempest-ServerActionsTestOtherA-1429663845 None] Created volume successfully. Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-d77980d0-617e-4007-b4ce-2076eb7a8277" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d77980d0-617e-4007-b4ce-2076eb7a8277" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:48 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f 1073741824" returned: 0 in 0.733s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d852dd2b-c279-4b82-a191-018ad5e2f382]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:49 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f Sep 12 07:17:49 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:49 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 Sep 12 07:17:49 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:49 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f" returned: 0 in 0.537s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0449d1-41d3-4481-94b6-b09c50412cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68696727-2172-4614-8ccf-6135148a6b5f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf982ef6-5412-4f73-903e-7850f6b84afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:49 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277" returned: 0 in 0.789s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Volume volume-68696727-2172-4614-8ccf-6135148a6b5f (68696727-2172-4614-8ccf-6135148a6b5f): created successfully Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf982ef6-5412-4f73-903e-7850f6b84afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Flow 'volume_create_manager' (e1ba8d45-af34-435c-abff-dce557514488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1bd2782d-8777-4360-a633-844de64ed40a tempest-VolumesCloneTest-569238580 None] Created volume successfully. Sep 12 07:17:49 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277 Sep 12 07:17:49 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:49 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d77980d0-617e-4007-b4ce-2076eb7a8277" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d77980d0-617e-4007-b4ce-2076eb7a8277" released by "delete_volume" :: held 1.307s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['071cc2a0-3b2e-4f0f-a81a-9fee1a9b94cc'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:50 devstack cinder-volume[88013]: WARNING cinder.quota [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1185543171 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1185543171, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:17:50 devstack cinder-volume[88013]: WARNING cinder.quota [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1185543171 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1185543171, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['b6f7f975-066f-4146-848e-853fa593e72c', '17253258-7cdd-4626-9492-0f4e7b0e8bf4', '3bb8a647-7cba-4dfb-b8d8-e902807dd769', '389c73a3-6c32-4a9d-856c-1f7126f13d70'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:50 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:50 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:51 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.432s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2ff20b44-36f3-48fa-b422-ccdc4138873e tempest-GroupSnapshotsTest-2085937321 None] Delete group completed successfully. Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Flow 'volume_create_manager' (6456ac9e-422f-4c2c-9463-0198ad03a3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cd9637-5979-490f-ac2a-8b451b0681c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cd9637-5979-490f-ac2a-8b451b0681c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1155261536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b95eca-0091-49a3-99c0-7ca0e4a79acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72fd4428cb04425a4bc10bdb9cc2fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:17:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=68696727-2172-4614-8ccf-6135148a6b5f,status='creating',terminated_at=None,updated_at=2026-09-12T05:17:51Z,use_quota=True,user_id='6b198348cd8e483691f3de9b65ad04c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abed5646-3947-4ccb-a2a5-924ae2d2630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abed5646-3947-4ccb-a2a5-924ae2d2630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0864474-12fc-439b-ac0d-4f95ca0ca971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0864474-12fc-439b-ac0d-4f95ca0ca971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c1b95eca-0091-49a3-99c0-7ca0e4a79acf', 'volume_name': 'volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf', 'volume_size': 2, 'source_volid': '68696727-2172-4614-8ccf-6135148a6b5f', 'source_volstatus': 'available'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffafab67-c801-4f6a-ac86-46cd3b2c057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffafab67-c801-4f6a-ac86-46cd3b2c057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ba120c-9ef4-4c4b-a610-5b13b2847698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:17:51 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Volume c1b95eca-0091-49a3-99c0-7ca0e4a79acf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf', 'volume_size': 2, 'source_volid': '68696727-2172-4614-8ccf-6135148a6b5f', 'source_volstatus': 'available'} Sep 12 07:17:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot dee2d932-d79c-446b-9849-c0b5cbcb5789: deleting Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:51 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Cloning volume 68696727-2172-4614-8ccf-6135148a6b5f to volume c1b95eca-0091-49a3-99c0-7ca0e4a79acf Sep 12 07:17:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot dee2d932-d79c-446b-9849-c0b5cbcb5789: deleting {{(pid=88013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-bad29929-a810-4419-a2cc-264b763b40a5" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Creating offline snapshot a9ecabcc-540f-4d12-8925-a45ccc1778da of volume 68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bad29929-a810-4419-a2cc-264b763b40a5" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-c3ee079d-f5a8-4deb-a817-978148821058" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a2b25-69ca-4722-9dec-d7215844a5aa]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-c3ee079d-f5a8-4deb-a817-978148821058" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Deleting offline snapshot c3ee079d-f5a8-4deb-a817-978148821058 of volume bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] snapshot_file for this snap is: volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6e8448-77d8-43f3-8d9d-b78c79aa3ef3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:52 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f Sep 12 07:17:52 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:52 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 Sep 12 07:17:52 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:52 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f" returned: 0 in 0.634s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:52 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058" returned: 0 in 0.561s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bad29929-a810-4419-a2cc-264b763b40a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:17:52 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da 1G Sep 12 07:17:52 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fecccd-92ab-49a8-abe0-e8c0e74c2fb8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:52 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 Sep 12 07:17:52 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:53 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da 1G" returned: 0 in 0.544s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68696727-2172-4614-8ccf-6135148a6b5f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:53 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68696727-2172-4614-8ccf-6135148a6b5f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da Sep 12 07:17:53 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:53 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5" returned: 0 in 0.684s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:53 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 Sep 12 07:17:53 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:53 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68696727-2172-4614-8ccf-6135148a6b5f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da" returned: 0 in 0.498s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:53 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da is being set with open permissions: ugo+rw Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:53 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da Sep 12 07:17:53 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:53 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058" returned: 0 in 0.508s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:54 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058 Sep 12 07:17:54 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:54 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da" returned: 0 in 0.299s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:54 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info Sep 12 07:17:54 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:54 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5.c3ee079d-f5a8-4deb-a817-978148821058" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-c3ee079d-f5a8-4deb-a817-978148821058" released by "_delete_snapshot" :: held 2.194s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bad29929-a810-4419-a2cc-264b763b40a5" released by "delete_snapshot" :: held 2.253s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:54 devstack cinder-volume[88013]: WARNING cinder.quota [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1185543171 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1185543171, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['8bb0a28e-926b-4225-bc34-0c83badbfda7', '0cbbde42-faa3-45bf-884a-99d0f2f696a2', '238f1bf2-b229-41f5-95e0-a97eca0133bd', '1b1d9506-ec64-4fd6-bd46-806012457c05'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:54 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info" returned: 0 in 0.317s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:54 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info is being set with open permissions: ugo+rw Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:54 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info Sep 12 07:17:54 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b9e36751-b15f-4325-8624-3d5146c0a423 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot dee2d932-d79c-446b-9849-c0b5cbcb5789: deleted successfully Sep 12 07:17:54 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.info" returned: 0 in 0.489s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Acquiring lock "cinder-quobyte-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] snapshot: a9ecabcc-540f-4d12-8925-a45ccc1778da, volume: c1b95eca-0091-49a3-99c0-7ca0e4a79acf, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73305f-4137-4af3-8d08-7a2430a2fd81]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:55 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da Sep 12 07:17:55 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:55 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da" returned: 0 in 0.627s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68696727-2172-4614-8ccf-6135148a6b5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d1f60-f847-48ec-b4e5-bb7444e0b914]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:55 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f Sep 12 07:17:55 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-bad29929-a810-4419-a2cc-264b763b40a5" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bad29929-a810-4419-a2cc-264b763b40a5" acquired by "delete_volume" :: waited 0.086s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d1171-c846-4af8-be8b-f77d4afa4002]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:56 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 Sep 12 07:17:56 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:56 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f" returned: 0 in 0.725s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:56 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf Sep 12 07:17:56 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:56 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5" returned: 0 in 0.602s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:56 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5 Sep 12 07:17:56 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:57 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bad29929-a810-4419-a2cc-264b763b40a5" returned: 0 in 0.639s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bad29929-a810-4419-a2cc-264b763b40a5" released by "delete_volume" :: held 1.474s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:17:57 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['b2052738-ee09-4e6e-a2b3-819f1aea4432'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:58 devstack cinder-volume[88013]: WARNING cinder.db.api [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1185543171'] Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['f8a03033-7c09-4270-a641-d2409812be37', '7fa1adcc-9b4f-4dff-ad3d-4a1114023b8e', '8f567e16-7a72-4b64-838c-e0358ffff4e3', 'd08e96b7-821b-4446-ba79-8765549b3e9a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:17:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:17:58 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:17:58 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:17:59 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 12 07:17:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 1.096s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:17:59 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:17:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8b1d389c-d096-49b7-8dd7-b5092b72b8d1 tempest-GroupSnapshotsTest-2085937321 None] Delete group completed successfully. Sep 12 07:18:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-28e1b31e-021a-48bc-a9fb-2982c0786ccf tempest-GroupSnapshotsTest-2085937321 None] Group tempest-GroupSnapshotsTest-Group-1793941565: creating Sep 12 07:18:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-28e1b31e-021a-48bc-a9fb-2982c0786ccf tempest-GroupSnapshotsTest-2085937321 None] Group tempest-GroupSnapshotsTest-Group-1793941565: created successfully Sep 12 07:18:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-28e1b31e-021a-48bc-a9fb-2982c0786ccf tempest-GroupSnapshotsTest-2085937321 None] Create group completed successfully. Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=106,cinder:UPDATE=128,cinder:INSERT=28,cinder:DELETE=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=107,cinder:UPDATE=136,cinder:DELETE=11,cinder:INSERT=33 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (d461730f-3a3f-4a43-966f-951c3346ec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520dfd8c-4dd0-41b3-b5e5-c4be43e84f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520dfd8c-4dd0-41b3-b5e5-c4be43e84f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697942264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b633ff7-d41a-4494-9984-d1af6bbafe2c,host='devstack@QuobyteHD#QuobyteHD',id=d91ce833-dc2b-451c-b560-006fff7af7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:06Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913ce221-8932-46d0-97eb-73d2efabeb3c),volume_type_id=913ce221-8932-46d0-97eb-73d2efabeb3c)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945e866b-9e48-409f-8081-3ab0d2e09a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945e866b-9e48-409f-8081-3ab0d2e09a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1198113-a442-439b-aebd-5829ea33efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1198113-a442-439b-aebd-5829ea33efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91ce833-dc2b-451c-b560-006fff7af7a7', 'volume_name': 'volume-d91ce833-dc2b-451c-b560-006fff7af7a7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eb4dd9-fea7-4419-a13f-9f36eabdf24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eb4dd9-fea7-4419-a13f-9f36eabdf24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b193e576-a3d0-47e9-b679-8bf101a457af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Volume d91ce833-dc2b-451c-b560-006fff7af7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91ce833-dc2b-451c-b560-006fff7af7a7', 'volume_size': 1} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:06 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" returned: 0 in 9.550s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f, size 1024.00 MB, duration 9.55 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:18:06 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Converted 1024.00 MB image at 107.18 MB/s Sep 12 07:18:06 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf is being set with open permissions: ugo+rw Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:06 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf Sep 12 07:18:06 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:06 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" released by "_copy_volume_from_snapshot" :: held 11.354s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Acquiring lock "cinder-quobyte-a9ecabcc-540f-4d12-8925-a45ccc1778da" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-a9ecabcc-540f-4d12-8925-a45ccc1778da" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Deleting offline snapshot a9ecabcc-540f-4d12-8925-a45ccc1778da of volume 68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] snapshot_file for this snap is: volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a73117-0746-4ebd-8cd8-34c9041729e5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:06 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da Sep 12 07:18:06 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:06 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da" returned: 0 in 0.419s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68696727-2172-4614-8ccf-6135148a6b5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8154d-d00d-41a3-8e2a-6635ab998b1e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:06 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f Sep 12 07:18:06 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:07 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f" returned: 0 in 0.579s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:07 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da Sep 12 07:18:07 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:07 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da" returned: 0 in 0.337s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:07 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da Sep 12 07:18:07 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:08 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f.a9ecabcc-540f-4d12-8925-a45ccc1778da" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-a9ecabcc-540f-4d12-8925-a45ccc1778da" released by "_delete_snapshot" :: held 1.674s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.239s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.104s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b633ff7-d41a-4494-9984-d1af6bbafe2c,created_at=2026-09-12T05:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697942264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b633ff7-d41a-4494-9984-d1af6bbafe2c,host='devstack@QuobyteHD#QuobyteHD',id=d91ce833-dc2b-451c-b560-006fff7af7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:06Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913ce221-8932-46d0-97eb-73d2efabeb3c),volume_type_id=913ce221-8932-46d0-97eb-73d2efabeb3c)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Creating volume d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:08 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ba120c-9ef4-4c4b-a610-5b13b2847698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf', 'volume_size': 2, 'source_volid': '68696727-2172-4614-8ccf-6135148a6b5f', 'source_volstatus': 'available'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e2b47-790d-47a7-9ae6-228439b71725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:08 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 1073741824 Sep 12 07:18:08 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Volume volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf (c1b95eca-0091-49a3-99c0-7ca0e4a79acf): created successfully Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e2b47-790d-47a7-9ae6-228439b71725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Flow 'volume_create_manager' (6456ac9e-422f-4c2c-9463-0198ad03a3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8b016757-e224-4a11-b2b4-e0794f54db5e tempest-VolumesCloneTest-569238580 None] Created volume successfully. Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Acquiring lock "cinder-c1b95eca-0091-49a3-99c0-7ca0e4a79acf-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:08 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 1073741824" returned: 0 in 0.556s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Lock "cinder-c1b95eca-0091-49a3-99c0-7ca0e4a79acf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Acquiring lock "cinder-quobyte-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" acquired by "delete_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:08 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 Sep 12 07:18:08 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[69956c34-1bdc-4a0b-a708-56bf8239f56b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:08 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf Sep 12 07:18:08 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:08 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b193e576-a3d0-47e9-b679-8bf101a457af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91ce833-dc2b-451c-b560-006fff7af7a7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88841bd3-037d-447c-955d-3962505a3fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Volume volume-d91ce833-dc2b-451c-b560-006fff7af7a7 (d91ce833-dc2b-451c-b560-006fff7af7a7): created successfully Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88841bd3-037d-447c-955d-3962505a3fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (d461730f-3a3f-4a43-966f-951c3346ec79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0020ec9e-ae26-4cf8-a429-8eb454707c88 tempest-GroupSnapshotsTest-2085937321 None] Created volume successfully. Sep 12 07:18:09 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:09 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf Sep 12 07:18:09 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:09 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" returned: 0 in 0.284s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-c1b95eca-0091-49a3-99c0-7ca0e4a79acf" released by "delete_volume" :: held 0.714s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Created reservations ['1570eef8-c512-49e1-8884-dba5a9e11699', '0d536165-0ed9-424f-927f-debdd748d8aa', 'd1bfc373-4e0c-484c-8268-d4f3ac27afd9', '4f71b0d4-6d28-444f-b2fb-43bf314c8f6c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:09 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:09 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:09 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.343s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Deleted volume successfully. Sep 12 07:18:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Acquiring lock "cinder-68696727-2172-4614-8ccf-6135148a6b5f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Lock "cinder-68696727-2172-4614-8ccf-6135148a6b5f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d4248a4c-b51e-4aff-a55e-ba62d0c683c6 tempest-VolumesCloneTest-569238580 None] Lock "cinder-c1b95eca-0091-49a3-99c0-7ca0e4a79acf-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Acquiring lock "cinder-quobyte-68696727-2172-4614-8ccf-6135148a6b5f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-68696727-2172-4614-8ccf-6135148a6b5f" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d589f65-62d2-4cb6-8ae5-918ae47adcfd]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (3baddbc2-56b5-4a02-8010-d9b099a7c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c799f6c4-6945-4b43-925d-2d436f8e085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c799f6c4-6945-4b43-925d-2d436f8e085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-782940495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b633ff7-d41a-4494-9984-d1af6bbafe2c,host='devstack@QuobyteHD#QuobyteHD',id=bf95dda0-c0a8-48e1-9e6f-42468526d107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:10Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913ce221-8932-46d0-97eb-73d2efabeb3c),volume_type_id=913ce221-8932-46d0-97eb-73d2efabeb3c)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7eab37-3441-4b82-85d5-133321df806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7eab37-3441-4b82-85d5-133321df806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e34bd4-d24d-4228-a7d7-82a59c20716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e34bd4-d24d-4228-a7d7-82a59c20716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf95dda0-c0a8-48e1-9e6f-42468526d107', 'volume_name': 'volume-bf95dda0-c0a8-48e1-9e6f-42468526d107', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:10 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b22d5da-b8ed-483b-aba4-7ba5f225b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:10 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b22d5da-b8ed-483b-aba4-7ba5f225b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2865aca2-a2d2-4b77-b04b-584647563fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Volume bf95dda0-c0a8-48e1-9e6f-42468526d107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf95dda0-c0a8-48e1-9e6f-42468526d107', 'volume_size': 1} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b633ff7-d41a-4494-9984-d1af6bbafe2c,created_at=2026-09-12T05:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-782940495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b633ff7-d41a-4494-9984-d1af6bbafe2c,host='devstack@QuobyteHD#QuobyteHD',id=bf95dda0-c0a8-48e1-9e6f-42468526d107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:10Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913ce221-8932-46d0-97eb-73d2efabeb3c),volume_type_id=913ce221-8932-46d0-97eb-73d2efabeb3c)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Creating volume bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:10 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:10 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 1073741824 Sep 12 07:18:10 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:10 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f" returned: 0 in 0.430s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:10 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f Sep 12 07:18:10 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:10 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 1073741824" returned: 0 in 0.457s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:10 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 Sep 12 07:18:10 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:10 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-68696727-2172-4614-8ccf-6135148a6b5f" returned: 0 in 0.290s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Lock "cinder-quobyte-68696727-2172-4614-8ccf-6135148a6b5f" released by "delete_volume" :: held 0.797s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:10 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Created reservations ['3f5de0ca-89fa-4d5e-b6cf-8230e0374117', '4176a54e-aa65-46cf-a301-68c09853252e', 'f3af96fe-3a1e-4ce1-a978-f63673871412', 'c38c605e-a718-4802-bfe3-460ec35695a6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:11 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:11 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:11 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2865aca2-a2d2-4b77-b04b-584647563fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf95dda0-c0a8-48e1-9e6f-42468526d107', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e7f5ee-95e3-4b13-8bfd-a81ec2cac670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:11 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Volume volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 (bf95dda0-c0a8-48e1-9e6f-42468526d107): created successfully Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e7f5ee-95e3-4b13-8bfd-a81ec2cac670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (3baddbc2-56b5-4a02-8010-d9b099a7c654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9248b08d-73e3-423d-8499-f46e049fed08 tempest-GroupSnapshotsTest-2085937321 None] Created volume successfully. Sep 12 07:18:11 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.463s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Deleted volume successfully. Sep 12 07:18:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4d96129e-fb18-4cee-b1c0-4a5d3f050291 tempest-VolumesCloneTest-569238580 None] Lock "cinder-68696727-2172-4614-8ccf-6135148a6b5f-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b70c9af7-db4b-4820-8ee7-5ddc6f9620de tempest-GroupSnapshotsTest-2085937321 None] Update group completed successfully. Sep 12 07:18:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bf7459c2-2ae8-4acc-a273-3f3cb467cdcc tempest-GroupSnapshotsTest-2085937321 None] Update group completed successfully. Sep 12 07:18:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9f26cc88-a448-4303-9889-17393043c87b tempest-GroupSnapshotsTest-2085937321 None] Update group completed successfully. Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Flow 'volume_create_manager' (43b2c799-ae6a-46c9-8553-0a705927e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e9d92c-4970-49e9-bf06-845240e8b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e9d92c-4970-49e9-bf06-845240e8b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-686772306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e78a2d9-e12a-4189-a6aa-debda8b37d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09fe8af79695498995b800b9280aec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:16Z,use_quota=True,user_id='9e67139e624440e9b3bdc063432ab28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1910244-9e56-4f6b-b90d-d02d3b3e98f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1910244-9e56-4f6b-b90d-d02d3b3e98f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e1ea3a-0232-443f-8cba-91682b48cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e1ea3a-0232-443f-8cba-91682b48cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e78a2d9-e12a-4189-a6aa-debda8b37d54', 'volume_name': 'volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54', 'volume_size': 2}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25046b78-bc4d-43a4-b576-706e22756d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25046b78-bc4d-43a4-b576-706e22756d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebed09a-7029-4132-b5b1-f499dcc11578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Volume 4e78a2d9-e12a-4189-a6aa-debda8b37d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54', 'volume_size': 2} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-686772306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e78a2d9-e12a-4189-a6aa-debda8b37d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09fe8af79695498995b800b9280aec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:16Z,use_quota=True,user_id='9e67139e624440e9b3bdc063432ab28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Creating volume 4e78a2d9-e12a-4189-a6aa-debda8b37d54 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:15 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 2147483648 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:15 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 2147483648 Sep 12 07:18:15 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:16 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 2147483648" returned: 0 in 0.450s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:16 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 Sep 12 07:18:16 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:16 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54" returned: 0 in 0.258s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebed09a-7029-4132-b5b1-f499dcc11578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54', 'volume_size': 2}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16400b54-3464-4e0f-895d-483e2881a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Volume volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 (4e78a2d9-e12a-4189-a6aa-debda8b37d54): created successfully Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16400b54-3464-4e0f-895d-483e2881a291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Flow 'volume_create_manager' (43b2c799-ae6a-46c9-8553-0a705927e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-672aa4e9-22a6-4134-be84-e9592ae93fdf tempest-VolumesCloneNegativeTest-780588762 None] Created volume successfully. Sep 12 07:18:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-562939ef-1245-4f60-8c8e-e31adf35f22f tempest-GroupSnapshotsTest-2085937321 None] Update group completed successfully. Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Acquiring lock "cinder-4e78a2d9-e12a-4189-a6aa-debda8b37d54-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Lock "cinder-4e78a2d9-e12a-4189-a6aa-debda8b37d54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Acquiring lock "cinder-quobyte-4e78a2d9-e12a-4189-a6aa-debda8b37d54" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Lock "cinder-quobyte-4e78a2d9-e12a-4189-a6aa-debda8b37d54" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b1f31e-e7c5-4957-b22e-8de11b03f69f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:17 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 Sep 12 07:18:17 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:17 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:17 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54 Sep 12 07:18:17 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:17 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e78a2d9-e12a-4189-a6aa-debda8b37d54" returned: 0 in 0.309s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Lock "cinder-quobyte-4e78a2d9-e12a-4189-a6aa-debda8b37d54" released by "delete_volume" :: held 0.744s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Created reservations ['4c2c3dc8-e953-43fd-83b5-2a90be828f47', 'c9e7df31-6af9-4a14-bfa1-0e53ed347628', 'f2f5938f-022d-4b64-aaa2-564439b1be8e', '85add883-38c9-4008-8213-87fabd54f3a0'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:17 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:17 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:18 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] GroupSnapshot 9967aec1-d0b0-4978-bc3e-8de68ba052ba: creating. Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.476s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Deleted volume successfully. Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Group snapshot 9967aec1-d0b0-4978-bc3e-8de68ba052ba: creating. {{(pid=88013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5d49d8b9-85b5-42ed-aa71-897a3f644446 tempest-VolumesCloneNegativeTest-780588762 None] Lock "cinder-4e78a2d9-e12a-4189-a6aa-debda8b37d54-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Creating offline snapshot 1b2d3619-1206-426b-807f-c17d061534c8 of volume d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[884fb012-f5dd-4e6a-98a8-64701c155446]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:18 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 Sep 12 07:18:18 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:18 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7" returned: 0 in 0.458s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:18 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 1G Sep 12 07:18:18 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:19 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 1G" returned: 0 in 0.555s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91ce833-dc2b-451c-b560-006fff7af7a7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:19 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91ce833-dc2b-451c-b560-006fff7af7a7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 Sep 12 07:18:19 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:19 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91ce833-dc2b-451c-b560-006fff7af7a7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8" returned: 0 in 0.429s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:19 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:18:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:19 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 Sep 12 07:18:19 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:20 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8" returned: 0 in 0.383s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:20 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info Sep 12 07:18:20 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:20 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info" returned: 0 in 0.294s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:20 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:20 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info Sep 12 07:18:20 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:20 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.info" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Creating offline snapshot a21398a2-1027-4026-a864-253d94edaa2c of volume bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6349fd6-3c0b-4378-9d98-924023b88ea6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:20 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 Sep 12 07:18:20 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:21 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107" returned: 0 in 0.374s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:21 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c 1G Sep 12 07:18:21 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:21 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c 1G" returned: 0 in 0.485s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:21 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c Sep 12 07:18:21 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:22 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:22 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:22 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c Sep 12 07:18:22 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:22 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c" returned: 0 in 0.279s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:22 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info Sep 12 07:18:22 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:22 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:22 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:22 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info Sep 12 07:18:22 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:22 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.info" returned: 0 in 0.288s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-760c7682-2c8c-4c40-a1e4-fdd525c6c63d tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 9967aec1-d0b0-4978-bc3e-8de68ba052ba: created successfully Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Flow 'volume_create_manager' (09d603cd-faa9-43cc-8be3-2935daf37b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1be6606-f4c2-4b0d-877c-034b16126dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1be6606-f4c2-4b0d-877c-034b16126dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1407473137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b9c86a-6879-459e-b078-2ba70ad1ef0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2742ae72f74718bfe48f48df64cd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:23Z,use_quota=True,user_id='b4ebc8c332994c5697a8e4f509ad8978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d812d9-478e-4376-9a0e-148893f9b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d812d9-478e-4376-9a0e-148893f9b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea83e0b-fd2f-4391-9820-9654f0bdf798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:18:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 9967aec1-d0b0-4978-bc3e-8de68ba052ba: deleting Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 9967aec1-d0b0-4978-bc3e-8de68ba052ba: deleting {{(pid=88013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-d91ce833-dc2b-451c-b560-006fff7af7a7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea83e0b-fd2f-4391-9820-9654f0bdf798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5b9c86a-6879-459e-b078-2ba70ad1ef0f', 'volume_name': 'volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a98ead-e12d-4783-a6e6-38a0663ca41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a98ead-e12d-4783-a6e6-38a0663ca41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdabb323-ffcc-4814-947f-21da93d4f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Volume e5b9c86a-6879-459e-b078-2ba70ad1ef0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Trying to clone e5b9c86a-6879-459e-b078-2ba70ad1ef0f from image a5243768-15a1-4db8-a379-25d46ec5cd8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d91ce833-dc2b-451c-b560-006fff7af7a7" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-1b2d3619-1206-426b-807f-c17d061534c8" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-1b2d3619-1206-426b-807f-c17d061534c8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Deleting offline snapshot 1b2d3619-1206-426b-807f-c17d061534c8 of volume d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] snapshot_file for this snap is: volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e52f7-6d5b-4487-9e62-c596d4512958]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:24 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 Sep 12 07:18:24 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:24 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:18:24 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Image download 20.69 MB at 20.69 MB/s Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8" returned: 0 in 0.487s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91ce833-dc2b-451c-b560-006fff7af7a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c979c4-3035-421d-b0ba-fdc37d706933]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b8387-709c-4fec-b16d-0c9b83d2f4d3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:24 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 Sep 12 07:18:24 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:24 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD Sep 12 07:18:24 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:24 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c is fetched for user b4ebc8c332994c5697a8e4f509ad8978. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:18:24 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:24 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 Sep 12 07:18:24 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b712a-f417-4f78-8dda-ded76b227b43]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:25 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD Sep 12 07:18:25 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:25 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8" returned: 0 in 0.417s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:25 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8 Sep 12 07:18:25 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:25 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1407473137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b9c86a-6879-459e-b078-2ba70ad1ef0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2742ae72f74718bfe48f48df64cd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:23Z,use_quota=True,user_id='b4ebc8c332994c5697a8e4f509ad8978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Creating volume e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:25 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:25 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 1073741824 Sep 12 07:18:25 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:25 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7.1b2d3619-1206-426b-807f-c17d061534c8" returned: 0 in 0.301s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-1b2d3619-1206-426b-807f-c17d061534c8" released by "_delete_snapshot" :: held 1.770s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d91ce833-dc2b-451c-b560-006fff7af7a7" released by "delete_snapshot" :: held 1.797s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-bf95dda0-c0a8-48e1-9e6f-42468526d107" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bf95dda0-c0a8-48e1-9e6f-42468526d107" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-a21398a2-1027-4026-a864-253d94edaa2c" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-a21398a2-1027-4026-a864-253d94edaa2c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Deleting offline snapshot a21398a2-1027-4026-a864-253d94edaa2c of volume bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] snapshot_file for this snap is: volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca13fb3-3227-4218-bc51-978938ec5264]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:25 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c Sep 12 07:18:25 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:26 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 1073741824" returned: 0 in 0.571s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:26 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f Sep 12 07:18:26 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:26 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c" returned: 0 in 0.464s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf95dda0-c0a8-48e1-9e6f-42468526d107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ebc234-cabd-499c-bf02-72933222018a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:26 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" returned: 0 in 0.342s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Attempting download of a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume e5b9c86a-6879-459e-b078-2ba70ad1ef0f. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:18:26 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 Sep 12 07:18:26 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5bf5a3-008f-416f-b8c8-9777b96164e2]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:26 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n Sep 12 07:18:26 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:27 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107" returned: 0 in 0.695s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:27 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c Sep 12 07:18:27 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:27 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n" returned: 0 in 0.807s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:27 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n Sep 12 07:18:27 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:27 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c" returned: 0 in 0.669s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:27 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c Sep 12 07:18:27 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-1f5d97e3-344d-423c-b0b2-09f8c39b6c7a req-446ddbda-a469-4cc3-8060-4c798a6bc65b tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-1f5d97e3-344d-423c-b0b2-09f8c39b6c7a req-446ddbda-a469-4cc3-8060-4c798a6bc65b tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-1f5d97e3-344d-423c-b0b2-09f8c39b6c7a req-446ddbda-a469-4cc3-8060-4c798a6bc65b tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-1f5d97e3-344d-423c-b0b2-09f8c39b6c7a req-446ddbda-a469-4cc3-8060-4c798a6bc65b tempest-ServerActionsTestOtherA-1429663845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-a069e668-bd23-4ad1-9008-9a01657685bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e591224-bbbb-4ba1-8d99-42ff5b7e21c6', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:18:28 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n" returned: 1 in 0.792s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_a7ev67_n' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e1750a-e645-4a2e-8e45-b696f6184528]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:28 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107.a21398a2-1027-4026-a864-253d94edaa2c" returned: 0 in 0.567s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-a21398a2-1027-4026-a864-253d94edaa2c" released by "_delete_snapshot" :: held 2.540s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bf95dda0-c0a8-48e1-9e6f-42468526d107" released by "delete_snapshot" :: held 2.587s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-1f5d97e3-344d-423c-b0b2-09f8c39b6c7a req-446ddbda-a469-4cc3-8060-4c798a6bc65b tempest-ServerActionsTestOtherA-1429663845 None] attachment_update completed successfully. Sep 12 07:18:28 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD Sep 12 07:18:28 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:28 devstack cinder-volume[88013]: WARNING cinder.quota [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-231344318 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-231344318, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:18:28 devstack cinder-volume[88013]: WARNING cinder.quota [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-231344318 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-231344318, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['f93d4ad5-48ac-4ba2-9b5a-c11d55a648f9', '0f78f129-9d17-48b9-b859-bffaf80b57cb', '5ed3aec1-9422-47e3-9c9e-324e3b2666ee', '306f2075-3840-41f7-b222-b1025398ea52'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:28 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] a5243768-15a1-4db8-a379-25d46ec5cd8c was qcow2, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:28 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f Sep 12 07:18:28 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:28 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['7d327917-6528-4b42-be2e-841a77ffbeee', '881ca7bf-f44f-48d7-80ca-2d9d32eca400', '66a5806d-ac3e-4780-ab39-c5d9aa0ab414', '60ec7b15-acbc-4d31-999d-5659aebdc8de'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d11716f0-dace-4da9-8698-d95b7744d1c9 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 9967aec1-d0b0-4978-bc3e-8de68ba052ba: deleted successfully Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-bf95dda0-c0a8-48e1-9e6f-42468526d107" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bf95dda0-c0a8-48e1-9e6f-42468526d107" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8fc6a4-c27b-482a-861e-48572e27555a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:30 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:30 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:30 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 Sep 12 07:18:30 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:31 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.625s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:18:31 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107" returned: 0 in 0.900s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:31 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107 Sep 12 07:18:31 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:31 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf95dda0-c0a8-48e1-9e6f-42468526d107" returned: 0 in 0.494s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-bf95dda0-c0a8-48e1-9e6f-42468526d107" released by "delete_volume" :: held 1.572s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-d91ce833-dc2b-451c-b560-006fff7af7a7" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d91ce833-dc2b-451c-b560-006fff7af7a7" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf27142-7a41-46d8-ad7c-3e3f95c0d984]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:32 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 Sep 12 07:18:32 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:32 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" returned: 0 in 3.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_cd0k3agddevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:18:32 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Converted 112.00 MB image at 34.40 MB/s Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:32 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 1G Sep 12 07:18:32 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:32 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7" returned: 0 in 0.726s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:32 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7 Sep 12 07:18:32 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:32 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 1G" returned: 0 in 0.556s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Downloaded image a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume e5b9c86a-6879-459e-b078-2ba70ad1ef0f successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c for user b4ebc8c332994c5697a8e4f509ad8978 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Marking volume e5b9c86a-6879-459e-b078-2ba70ad1ef0f as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Copying metadata from image a5243768-15a1-4db8-a379-25d46ec5cd8c to e5b9c86a-6879-459e-b078-2ba70ad1ef0f. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Creating volume glance metadata for volume e5b9c86a-6879-459e-b078-2ba70ad1ef0f backed by image a5243768-15a1-4db8-a379-25d46ec5cd8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:18:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-31f99d11-393b-4bf2-9366-74f31cf6e9c7 tempest-ServerActionsTestOtherA-1429663845 None] Terminate volume connection completed successfully. Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-31f99d11-393b-4bf2-9366-74f31cf6e9c7 tempest-ServerActionsTestOtherA-1429663845 None] Deleting attachment 3e591224-bbbb-4ba1-8d99-42ff5b7e21c6. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdabb323-ffcc-4814-947f-21da93d4f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c07c77-7db2-459f-aea7-a197dbb6c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:32 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Volume volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f (e5b9c86a-6879-459e-b078-2ba70ad1ef0f): created successfully Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c07c77-7db2-459f-aea7-a197dbb6c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Flow 'volume_create_manager' (09d603cd-faa9-43cc-8be3-2935daf37b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e4cce10c-fbb2-46c6-ad0b-2e5ca6f8f5ea tempest-VolumesExtendTest-1659777847 None] Created volume successfully. Sep 12 07:18:33 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d91ce833-dc2b-451c-b560-006fff7af7a7" returned: 0 in 0.666s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-d91ce833-dc2b-451c-b560-006fff7af7a7" released by "delete_volume" :: held 1.567s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:33 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['d0489137-3e16-42da-8980-31e67fbc0cab'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:33 devstack cinder-volume[88013]: WARNING cinder.quota [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-231344318 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-231344318, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:18:33 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['3257f09d-d15f-4f3f-b465-83562047f508', '91a7a91b-5cb2-4579-956c-cb6dabc0ee6e', 'b7c07b71-013f-4777-a2a3-08a7d41cc760', 'f61e569c-5004-4fc0-99f8-f5ffe3cf42db'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['80196710-6d34-4065-aff0-dba4c4c6b515', '1ced6e5e-6d8b-4adf-a0da-35e30bf0c358', '87669654-fcef-4a48-800b-2faad7ec8033', '270bc863-3d32-4c83-a39a-15d8fd437acb'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-f3e87ba3-9685-4216-8736-14b786cc6b50 tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-f3e87ba3-9685-4216-8736-14b786cc6b50 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-f3e87ba3-9685-4216-8736-14b786cc6b50 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-f3e87ba3-9685-4216-8736-14b786cc6b50 tempest-ServerActionsTestOtherA-1429663845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-a069e668-bd23-4ad1-9008-9a01657685bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bf3b84f-9d63-485d-a067-d1f499b211e5', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:18:34 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:34 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5f6980-97cf-4066-8ada-2342bc97af57]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-25c87eaa-3c5f-4cbd-9532-9b5f233f8893 req-f3e87ba3-9685-4216-8736-14b786cc6b50 tempest-ServerActionsTestOtherA-1429663845 None] attachment_update completed successfully. Sep 12 07:18:35 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f Sep 12 07:18:35 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:35 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.878s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:35 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6b8649e6-d925-4849-a7c1-0cbd718916a9 tempest-GroupSnapshotsTest-2085937321 None] Delete group completed successfully. Sep 12 07:18:35 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" returned: 0 in 1.053s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 2G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f 2G" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.376s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2b26754a-1a9f-4995-b718-6ce36e0066a2 tempest-VolumesExtendTest-1659777847 None] Extend volume completed successfully. Sep 12 07:18:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a1b56c22-ccea-431f-966c-5221ee6a7610 tempest-GroupSnapshotsTest-2085937321 None] Group tempest-GroupSnapshotsTest-Group-2120467491: creating Sep 12 07:18:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a1b56c22-ccea-431f-966c-5221ee6a7610 tempest-GroupSnapshotsTest-2085937321 None] Group tempest-GroupSnapshotsTest-Group-2120467491: created successfully Sep 12 07:18:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a1b56c22-ccea-431f-966c-5221ee6a7610 tempest-GroupSnapshotsTest-2085937321 None] Create group completed successfully. Sep 12 07:18:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-e5b9c86a-6879-459e-b078-2ba70ad1ef0f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Lock "cinder-e5b9c86a-6879-459e-b078-2ba70ad1ef0f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-quobyte-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" acquired by "delete_volume" :: waited 0.045s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:37 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f4ab2b-c357-4c5c-8405-e78593af5e67]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:38 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f Sep 12 07:18:38 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:38 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" returned: 0 in 0.672s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:38 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f Sep 12 07:18:38 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (c87c3435-9b46-47b1-a5b9-2321ea335197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1caa52-d48f-472c-a078-385ddf375bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:38 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1caa52-d48f-472c-a078-385ddf375bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492914744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d16f1a2e-12f4-4126-98a4-890c3c1e4230,host='devstack@QuobyteHD#QuobyteHD',id=0a6012e5-db44-4fc7-b7bc-e7c750b30318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:39Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c3f5545-062e-4abf-90df-9860182979ce),volume_type_id=7c3f5545-062e-4abf-90df-9860182979ce)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13419ac-af14-4674-91ff-c82c53b425cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13419ac-af14-4674-91ff-c82c53b425cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4a87d5-9341-460f-af3f-cec6a2af9b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4a87d5-9341-460f-af3f-cec6a2af9b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6012e5-db44-4fc7-b7bc-e7c750b30318', 'volume_name': 'volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ba7209-1e0f-4593-9e16-92b1e5cdd4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ba7209-1e0f-4593-9e16-92b1e5cdd4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33b9d09-ab1d-4428-bcb7-32276dfb9f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:38 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Volume 0a6012e5-db44-4fc7-b7bc-e7c750b30318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318', 'volume_size': 1} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d16f1a2e-12f4-4126-98a4-890c3c1e4230,created_at=2026-09-12T05:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492914744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d16f1a2e-12f4-4126-98a4-890c3c1e4230,host='devstack@QuobyteHD#QuobyteHD',id=0a6012e5-db44-4fc7-b7bc-e7c750b30318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada2f2abdaaf432697f7998f95752136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:39Z,use_quota=True,user_id='73fb898deaed4d45a8a90d6c049a8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c3f5545-062e-4abf-90df-9860182979ce),volume_type_id=7c3f5545-062e-4abf-90df-9860182979ce)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Creating volume 0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:38 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" returned: 0 in 0.420s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-e5b9c86a-6879-459e-b078-2ba70ad1ef0f" released by "delete_volume" :: held 1.188s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:39 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 1073741824 Sep 12 07:18:39 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Created reservations ['f59c8bc2-9f4c-4d5a-90a1-790bf9efea3b', '99c481ed-6f6b-4d33-bf3d-7fd4e776d51b', '5b824f8b-f195-4c1a-a738-de66ea7293af', '9c9df54e-87e4-4956-b3a8-3be638eb12f3'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:39 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:39 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:39 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:39 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.621s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 1073741824" returned: 0 in 0.809s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:39 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Deleted volume successfully. Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-76263400-cce9-4a20-95ce-3b98c34c676f tempest-VolumesExtendTest-1659777847 None] Lock "cinder-e5b9c86a-6879-459e-b078-2ba70ad1ef0f-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:39 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 Sep 12 07:18:39 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:40 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33b9d09-ab1d-4428-bcb7-32276dfb9f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cf956d-2b26-4340-a65f-7b2c3bf22317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:40 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Volume volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 (0a6012e5-db44-4fc7-b7bc-e7c750b30318): created successfully Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cf956d-2b26-4340-a65f-7b2c3bf22317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Flow 'volume_create_manager' (c87c3435-9b46-47b1-a5b9-2321ea335197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:40 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-16566177-9389-4353-8ce3-52331cad70a3 tempest-GroupSnapshotsTest-2085937321 None] Created volume successfully. Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Flow 'volume_create_manager' (7b1906f7-d1eb-4666-96ed-d51a0fb9e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea4364b-4355-4792-919b-e7815f987006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea4364b-4355-4792-919b-e7815f987006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-358449716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65759fa-4828-4cbc-8165-527bc538d092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2742ae72f74718bfe48f48df64cd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:41Z,use_quota=True,user_id='b4ebc8c332994c5697a8e4f509ad8978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56ccee2-4ac6-43f8-80e9-dca6a86bc91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56ccee2-4ac6-43f8-80e9-dca6a86bc91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14fb819-c23b-4a49-9fa7-3feae345a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14fb819-c23b-4a49-9fa7-3feae345a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65759fa-4828-4cbc-8165-527bc538d092', 'volume_name': 'volume-b65759fa-4828-4cbc-8165-527bc538d092', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b3b7b-7df9-40bd-95f1-2ba9d01ad8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b3b7b-7df9-40bd-95f1-2ba9d01ad8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac8ca7-6503-4ee5-8088-41f201052104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:40 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Volume b65759fa-4828-4cbc-8165-527bc538d092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65759fa-4828-4cbc-8165-527bc538d092', 'volume_size': 1} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-358449716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65759fa-4828-4cbc-8165-527bc538d092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2742ae72f74718bfe48f48df64cd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:41Z,use_quota=True,user_id='b4ebc8c332994c5697a8e4f509ad8978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Creating volume b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:40 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:40 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 1073741824 Sep 12 07:18:40 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:41 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 1073741824" returned: 0 in 0.535s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:41 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 Sep 12 07:18:41 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:41 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092" returned: 0 in 0.386s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] GroupSnapshot 44e8ad5e-d2cd-4359-b3b7-545b674423e6: creating. Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac8ca7-6503-4ee5-8088-41f201052104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65759fa-4828-4cbc-8165-527bc538d092', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4234bce3-677b-4aef-a659-4f2562ded619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Group snapshot 44e8ad5e-d2cd-4359-b3b7-545b674423e6: creating. {{(pid=88013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:41 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Volume volume-b65759fa-4828-4cbc-8165-527bc538d092 (b65759fa-4828-4cbc-8165-527bc538d092): created successfully Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4234bce3-677b-4aef-a659-4f2562ded619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Flow 'volume_create_manager' (7b1906f7-d1eb-4666-96ed-d51a0fb9e857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Creating offline snapshot 390039c7-c71b-40c1-9172-85cc745efa28 of volume 0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:18:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-08604103-87c3-44f1-b81f-2399320898b7 tempest-VolumesExtendTest-1659777847 None] Created volume successfully. Sep 12 07:18:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a952707e-d16d-4198-b66b-5c61ef27122c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:42 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 Sep 12 07:18:42 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:42 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:42 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 1G Sep 12 07:18:42 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:42 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 1G" returned: 0 in 0.401s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:42 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 Sep 12 07:18:42 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:43 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28" returned: 0 in 0.306s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:43 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:43 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 Sep 12 07:18:43 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:43 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:43 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info Sep 12 07:18:43 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:43 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:43 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:43 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info Sep 12 07:18:43 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:43 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.info" returned: 0 in 0.235s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Creating offline snapshot 7f8469a7-592c-4a75-bd6f-0697bc5c52fa of volume b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d8984a-bb5b-4f3b-8ff1-69aa362b2130]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:43 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-97799779-0463-4574-8f55-964338ea5201 tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 44e8ad5e-d2cd-4359-b3b7-545b674423e6: created successfully Sep 12 07:18:44 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 Sep 12 07:18:44 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 44e8ad5e-d2cd-4359-b3b7-545b674423e6: deleting Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 44e8ad5e-d2cd-4359-b3b7-545b674423e6: deleting {{(pid=88013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-0a6012e5-db44-4fc7-b7bc-e7c750b30318" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-0a6012e5-db44-4fc7-b7bc-e7c750b30318" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-390039c7-c71b-40c1-9172-85cc745efa28" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-390039c7-c71b-40c1-9172-85cc745efa28" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Deleting offline snapshot 390039c7-c71b-40c1-9172-85cc745efa28 of volume 0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:18:44 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] snapshot_file for this snap is: volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092" returned: 0 in 0.429s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9301259-91fb-4ea0-b632-9fb1fdecaa0c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:44 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa 1G Sep 12 07:18:44 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:44 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 Sep 12 07:18:44 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:44 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28" returned: 0 in 0.419s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:18:44 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa 1G" returned: 0 in 0.455s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65759fa-4828-4cbc-8165-527bc538d092 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd1cf9f-c40f-4521-9d22-9e3934eba8c9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:44 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65759fa-4828-4cbc-8165-527bc538d092 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa Sep 12 07:18:44 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:44 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 Sep 12 07:18:44 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:45 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65759fa-4828-4cbc-8165-527bc538d092 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa" returned: 0 in 0.286s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa is being set with open permissions: ugo+rw Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:45 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa Sep 12 07:18:45 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:45 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:45 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 Sep 12 07:18:45 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:45 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:45 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info Sep 12 07:18:45 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:45 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:45 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28 Sep 12 07:18:45 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:45 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info" returned: 0 in 0.303s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info is being set with open permissions: ugo+rw Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:45 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info Sep 12 07:18:45 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:45 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318.390039c7-c71b-40c1-9172-85cc745efa28" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-390039c7-c71b-40c1-9172-85cc745efa28" released by "_delete_snapshot" :: held 1.540s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-0a6012e5-db44-4fc7-b7bc-e7c750b30318" released by "delete_snapshot" :: held 1.572s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:45 devstack cinder-volume[88013]: WARNING cinder.quota [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1582157478 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1582157478, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:18:45 devstack cinder-volume[88013]: WARNING cinder.quota [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1582157478 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1582157478, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:18:45 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['fdad9428-abdf-429f-bd65-45d19d527d82', '9cd4701d-dfcd-471f-abcf-3bc1d501c8f9', 'fa191608-7fcd-4a33-affa-67ddf535f6d0', '06e93d06-af08-4448-b50d-3fc076e10bad'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.info" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:45 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-03f32d2d-4891-492a-8cba-8a087bf26212 tempest-VolumesExtendTest-1659777847 None] Create snapshot completed successfully Sep 12 07:18:46 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-77761286-c6cb-47c4-9a11-862785163aad tempest-GroupSnapshotsTest-2085937321 None] group_snapshot 44e8ad5e-d2cd-4359-b3b7-545b674423e6: deleted successfully Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56d4007-0021-4810-ba97-90768c553dfd]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:46 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 Sep 12 07:18:46 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "cinder-quobyte-0a6012e5-db44-4fc7-b7bc-e7c750b30318" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-0a6012e5-db44-4fc7-b7bc-e7c750b30318" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398032f-8e2a-4214-bbdc-e93c09b09ed7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:47 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa 2G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:47 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 Sep 12 07:18:47 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa 2G" returned: 0 in 0.133s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.599s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4e086125-c856-4621-a349-cceccdac4c09 tempest-VolumesExtendTest-1659777847 None] Extend volume completed successfully. Sep 12 07:18:47 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318" returned: 0 in 0.416s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:47 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318 Sep 12 07:18:47 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:47 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0a6012e5-db44-4fc7-b7bc-e7c750b30318" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Lock "cinder-quobyte-0a6012e5-db44-4fc7-b7bc-e7c750b30318" released by "delete_volume" :: held 0.711s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['60207e3a-e38f-499f-bcb2-2d5d52c97c80'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:47 devstack cinder-volume[88013]: WARNING cinder.quota [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1582157478 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1582157478, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Created reservations ['d4b1846d-0dae-4f1f-a0e9-3780dedccc94', '7a0695cb-6ced-4e48-82e3-8adda63cdd67', 'bde758ff-2af1-4d68-952f-5705f5a37bf6', 'c028d087-32ac-4728-b897-4e58ede0ddfe'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-7f8469a7-592c-4a75-bd6f-0697bc5c52fa-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:47 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:47 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Lock "cinder-7f8469a7-592c-4a75-bd6f-0697bc5c52fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-quobyte-b65759fa-4828-4cbc-8165-527bc538d092" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-b65759fa-4828-4cbc-8165-527bc538d092" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-quobyte-7f8469a7-592c-4a75-bd6f-0697bc5c52fa" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-7f8469a7-592c-4a75-bd6f-0697bc5c52fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Deleting offline snapshot 7f8469a7-592c-4a75-bd6f-0697bc5c52fa of volume b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] snapshot_file for this snap is: volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[259d4ee9-1863-4a00-941f-05377bdbdbea]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:48 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.332s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c3eab895-95af-440a-b644-b1fecd1afb5f tempest-GroupSnapshotsTest-2085937321 None] Delete group completed successfully. Sep 12 07:18:48 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa Sep 12 07:18:48 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:48 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa" returned: 0 in 0.552s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65759fa-4828-4cbc-8165-527bc538d092(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c6a9c-bd68-4e2d-a60c-919b43dc1a9c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:48 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 Sep 12 07:18:48 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:49 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092" returned: 0 in 0.507s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:49 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa Sep 12 07:18:49 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:49 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa" returned: 0 in 0.501s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:49 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa Sep 12 07:18:49 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:49 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092.7f8469a7-592c-4a75-bd6f-0697bc5c52fa" returned: 0 in 0.330s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-7f8469a7-592c-4a75-bd6f-0697bc5c52fa" released by "_delete_snapshot" :: held 2.054s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-b65759fa-4828-4cbc-8165-527bc538d092" released by "delete_snapshot" :: held 2.081s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Created reservations ['282d84e2-d1aa-489b-94cc-8b2fbfc5c0bd', 'a82a85f0-190a-4035-b0ea-380cdb393db4', '13e1912e-d246-4d24-a246-d1642b0b558c', 'c12c2a29-6f75-4576-93db-be516e246b06'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Delete snapshot completed successfully. Sep 12 07:18:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-af5b6a67-dfbd-41fb-bd7c-30b491411eb6 tempest-VolumesExtendTest-1659777847 None] Lock "cinder-7f8469a7-592c-4a75-bd6f-0697bc5c52fa-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-b65759fa-4828-4cbc-8165-527bc538d092-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Lock "cinder-b65759fa-4828-4cbc-8165-527bc538d092-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Acquiring lock "cinder-quobyte-b65759fa-4828-4cbc-8165-527bc538d092" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-b65759fa-4828-4cbc-8165-527bc538d092" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6192a309-acf3-412e-92fe-f8774d5e9411]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:51 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 Sep 12 07:18:51 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:51 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:51 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092 Sep 12 07:18:51 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:52 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b65759fa-4828-4cbc-8165-527bc538d092" returned: 0 in 0.274s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Lock "cinder-quobyte-b65759fa-4828-4cbc-8165-527bc538d092" released by "delete_volume" :: held 0.763s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Created reservations ['c1bba442-e48d-4f88-8114-dc457d621bfa', '1b0a511f-dbac-4df1-90e9-c644277e55d5', 'ab4d07b2-5535-4f57-8145-5da487e29e02', '17af353c-2eaa-4d8e-8842-681e8b376ab4'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:52 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:18:52 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:52 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.338s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:18:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Deleted volume successfully. Sep 12 07:18:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1d40432b-152c-402a-8450-5790c5e2433a tempest-VolumesExtendTest-1659777847 None] Lock "cinder-b65759fa-4828-4cbc-8165-527bc538d092-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Flow 'volume_create_manager' (1ce623cd-0a22-4d5f-a40f-bfc4e3f10331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef72e806-8238-4c9b-a2aa-b5c7fb2b4111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef72e806-8238-4c9b-a2aa-b5c7fb2b4111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-373008752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5a43e1-15b2-405a-aa34-474562479270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460ea0a101304d60a1b6d910dce3dfcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:54Z,use_quota=True,user_id='04011a4bfe334e2b989675e81263ebd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5f66c5-47ae-4b95-8de1-7c1232647dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5f66c5-47ae-4b95-8de1-7c1232647dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791ee228-f0f8-4628-bf84-5a2988bfc1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791ee228-f0f8-4628-bf84-5a2988bfc1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5a43e1-15b2-405a-aa34-474562479270', 'volume_name': 'volume-7d5a43e1-15b2-405a-aa34-474562479270', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22431751-706d-48a5-b81f-821e0a5f8b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22431751-706d-48a5-b81f-821e0a5f8b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6465d9c-e0fb-431b-a7ff-98aa5dee9beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Volume 7d5a43e1-15b2-405a-aa34-474562479270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5a43e1-15b2-405a-aa34-474562479270', 'volume_size': 1} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-373008752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5a43e1-15b2-405a-aa34-474562479270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460ea0a101304d60a1b6d910dce3dfcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:54Z,use_quota=True,user_id='04011a4bfe334e2b989675e81263ebd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Creating volume 7d5a43e1-15b2-405a-aa34-474562479270 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:54 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:54 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 1073741824 Sep 12 07:18:54 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:54 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 1073741824" returned: 0 in 0.508s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:54 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 Sep 12 07:18:54 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:55 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270" returned: 0 in 0.281s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6465d9c-e0fb-431b-a7ff-98aa5dee9beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5a43e1-15b2-405a-aa34-474562479270', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673cda1d-930f-4d15-9cc8-bb21f7f21b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:55 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Volume volume-7d5a43e1-15b2-405a-aa34-474562479270 (7d5a43e1-15b2-405a-aa34-474562479270): created successfully Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673cda1d-930f-4d15-9cc8-bb21f7f21b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Flow 'volume_create_manager' (1ce623cd-0a22-4d5f-a40f-bfc4e3f10331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:55 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-42167a39-9b9a-48d8-bb22-e2f0a709dac3 tempest-AttachVolumeTestJSON-380067606 None] Created volume successfully. Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-00d09e34-5b69-4482-a1dc-696360041c98 req-2a2a5d8a-8211-444b-a51c-e1f3444f83c7 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-00d09e34-5b69-4482-a1dc-696360041c98 req-2a2a5d8a-8211-444b-a51c-e1f3444f83c7 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-00d09e34-5b69-4482-a1dc-696360041c98 req-2a2a5d8a-8211-444b-a51c-e1f3444f83c7 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-00d09e34-5b69-4482-a1dc-696360041c98 req-2a2a5d8a-8211-444b-a51c-e1f3444f83c7 tempest-AttachVolumeTestJSON-380067606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-7d5a43e1-15b2-405a-aa34-474562479270', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ceaf9b43-9f22-47e7-a371-4bc9ce549a99', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Flow 'volume_create_manager' (08dc401d-d9ee-4a2b-8bf3-2698b927ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b03d40-e2df-489d-aae8-c8cd9fd1dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b03d40-e2df-489d-aae8-c8cd9fd1dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-231680410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1f545c-e1fc-4d37-9649-715d36abf305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a2f2a5da86416a966a226f8657c32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:57Z,use_quota=True,user_id='3a2824deb9604640b551983a1acec897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c255ced-c793-47c3-bfd5-848e32aaf406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c255ced-c793-47c3-bfd5-848e32aaf406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6ec86a-d774-4c89-876a-a285b63216ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6ec86a-d774-4c89-876a-a285b63216ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1f545c-e1fc-4d37-9649-715d36abf305', 'volume_name': 'volume-9b1f545c-e1fc-4d37-9649-715d36abf305', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b59795a-ed26-474c-a4aa-ca35e5e88bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b59795a-ed26-474c-a4aa-ca35e5e88bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547607d-abea-4e0e-a78d-51a426044c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:57 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Volume 9b1f545c-e1fc-4d37-9649-715d36abf305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1f545c-e1fc-4d37-9649-715d36abf305', 'volume_size': 1} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-231680410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1f545c-e1fc-4d37-9649-715d36abf305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a2f2a5da86416a966a226f8657c32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:18:57Z,use_quota=True,user_id='3a2824deb9604640b551983a1acec897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Creating volume 9b1f545c-e1fc-4d37-9649-715d36abf305 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:18:57 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:18:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-00d09e34-5b69-4482-a1dc-696360041c98 req-2a2a5d8a-8211-444b-a51c-e1f3444f83c7 tempest-AttachVolumeTestJSON-380067606 None] attachment_update completed successfully. Sep 12 07:18:57 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 1073741824 Sep 12 07:18:57 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:58 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 1073741824" returned: 0 in 0.574s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:18:58 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 Sep 12 07:18:58 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:18:58 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305" returned: 0 in 0.279s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547607d-abea-4e0e-a78d-51a426044c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1f545c-e1fc-4d37-9649-715d36abf305', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053b3751-6ec9-48fc-a644-a87f1d74b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:18:58 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Volume volume-9b1f545c-e1fc-4d37-9649-715d36abf305 (9b1f545c-e1fc-4d37-9649-715d36abf305): created successfully Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053b3751-6ec9-48fc-a644-a87f1d74b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:18:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Flow 'volume_create_manager' (08dc401d-d9ee-4a2b-8bf3-2698b927ce98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:58 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-310c14f2-7922-449c-af66-d552f6da419f tempest-VolumesNegativeTest-1860976928 None] Created volume successfully. Sep 12 07:18:59 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:18:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Flow 'volume_create_manager' (714c6198-2de4-4547-84f5-8f7ad67523c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:18:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b674fab9-4fea-4602-85fc-84d52b1157d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b674fab9-4fea-4602-85fc-84d52b1157d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-14856291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4d883f-52b2-425b-aa2e-2ef2a924c725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460ea0a101304d60a1b6d910dce3dfcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:19:00Z,use_quota=True,user_id='04011a4bfe334e2b989675e81263ebd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662f097c-fe0a-4a7e-a683-58e3d0acef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662f097c-fe0a-4a7e-a683-58e3d0acef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46655ff-ccc3-4a10-b4ef-9fd15f9128a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46655ff-ccc3-4a10-b4ef-9fd15f9128a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4d883f-52b2-425b-aa2e-2ef2a924c725', 'volume_name': 'volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d360d27-2ad3-4b2a-a70f-9aea0dfb7fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d360d27-2ad3-4b2a-a70f-9aea0dfb7fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a465a5-4a42-424c-a365-cbc5a952d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:00 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Volume 2c4d883f-52b2-425b-aa2e-2ef2a924c725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725', 'volume_size': 1} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-14856291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4d883f-52b2-425b-aa2e-2ef2a924c725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460ea0a101304d60a1b6d910dce3dfcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:19:00Z,use_quota=True,user_id='04011a4bfe334e2b989675e81263ebd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Creating volume 2c4d883f-52b2-425b-aa2e-2ef2a924c725 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:19:00 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:00 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 1073741824 Sep 12 07:19:00 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:00 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 1073741824" returned: 0 in 0.616s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:00 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 Sep 12 07:19:00 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:01 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725" returned: 0 in 0.353s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a465a5-4a42-424c-a365-cbc5a952d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca96cb-7adf-4dd2-a56b-d5b8ba7dcd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Volume volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 (2c4d883f-52b2-425b-aa2e-2ef2a924c725): created successfully Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca96cb-7adf-4dd2-a56b-d5b8ba7dcd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Flow 'volume_create_manager' (714c6198-2de4-4547-84f5-8f7ad67523c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:19:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-30dfcc53-7536-445b-81d1-6d11111ece47 tempest-AttachVolumeTestJSON-380067606 None] Created volume successfully. Sep 12 07:19:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5cd950ed-bd2f-46e9-a3e3-4d4c51cd2f93 tempest-GroupsV320Test-274352803 None] Group tempest-GroupsV320Test-Group-1529799122: creating Sep 12 07:19:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5cd950ed-bd2f-46e9-a3e3-4d4c51cd2f93 tempest-GroupsV320Test-274352803 None] Group tempest-GroupsV320Test-Group-1529799122: created successfully Sep 12 07:19:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5cd950ed-bd2f-46e9-a3e3-4d4c51cd2f93 tempest-GroupsV320Test-274352803 None] Create group completed successfully. Sep 12 07:19:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-1e61f727-591c-4995-8551-8faf6459fb67 req-31211d5c-5bbf-4fc3-9956-cb3abe751941 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-1e61f727-591c-4995-8551-8faf6459fb67 req-31211d5c-5bbf-4fc3-9956-cb3abe751941 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-1e61f727-591c-4995-8551-8faf6459fb67 req-31211d5c-5bbf-4fc3-9956-cb3abe751941 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-1e61f727-591c-4995-8551-8faf6459fb67 req-31211d5c-5bbf-4fc3-9956-cb3abe751941 tempest-AttachVolumeTestJSON-380067606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95c02f82-17e1-46f1-88b7-beca5f48a539', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:19:03 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-1e61f727-591c-4995-8551-8faf6459fb67 req-31211d5c-5bbf-4fc3-9956-cb3abe751941 tempest-AttachVolumeTestJSON-380067606 None] attachment_update completed successfully. Sep 12 07:19:03 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Created reservations ['9ffe7efe-7f5f-40d6-946b-5b43876b52dd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:04 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:19:04 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:04 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.325s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:04 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:19:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-37ddb98b-a863-41e4-8cec-9dda51b3de21 tempest-GroupsV320Test-274352803 None] Delete group completed successfully. Sep 12 07:19:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-92268674-c4a4-4f55-af6f-cb86e5f98e72 req-10a0cbfc-93db-4970-97df-5a44333a7a26 tempest-ServerActionsTestOtherA-1429663845 None] Terminate volume connection completed successfully. Sep 12 07:19:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-92268674-c4a4-4f55-af6f-cb86e5f98e72 req-10a0cbfc-93db-4970-97df-5a44333a7a26 tempest-ServerActionsTestOtherA-1429663845 None] Deleting attachment 3bf3b84f-9d63-485d-a067-d1f499b211e5. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:19:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-9a17c716-5ab3-48b5-bcf5-6ecda567bd6f req-d4499df2-3cb2-4775-8738-8b135ee1042c tempest-AttachVolumeTestJSON-380067606 None] Terminate volume connection completed successfully. Sep 12 07:19:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-9a17c716-5ab3-48b5-bcf5-6ecda567bd6f req-d4499df2-3cb2-4775-8738-8b135ee1042c tempest-AttachVolumeTestJSON-380067606 None] Deleting attachment ceaf9b43-9f22-47e7-a371-4bc9ce549a99. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:19:07 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=164,cinder:SELECT=161,cinder:DELETE=8,cinder:INSERT=33 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:19:07 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=166,cinder:UPDATE=140,cinder:INSERT=45,cinder:DELETE=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:19:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-2a83a3d0-2f69-41f7-af9d-ae21cbb703b7 req-8cd9354c-a2e2-47dd-8e6d-0c3c6cdd978c tempest-AttachVolumeTestJSON-380067606 None] Terminate volume connection completed successfully. Sep 12 07:19:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-2a83a3d0-2f69-41f7-af9d-ae21cbb703b7 req-8cd9354c-a2e2-47dd-8e6d-0c3c6cdd978c tempest-AttachVolumeTestJSON-380067606 None] Deleting attachment 95c02f82-17e1-46f1-88b7-beca5f48a539. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:19:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "cinder-2c4d883f-52b2-425b-aa2e-2ef2a924c725-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-2c4d883f-52b2-425b-aa2e-2ef2a924c725-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "cinder-quobyte-2c4d883f-52b2-425b-aa2e-2ef2a924c725" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-quobyte-2c4d883f-52b2-425b-aa2e-2ef2a924c725" acquired by "delete_volume" :: waited 0.032s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c882d-cb56-4952-aafd-f0500a73908d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:16 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 Sep 12 07:19:16 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:16 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725" returned: 0 in 0.482s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:19:16 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725 Sep 12 07:19:16 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Flow 'volume_create_manager' (7ffc3dee-3826-49bd-91ea-855c3d916a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bad160-7f3d-445d-b9db-25635cfacfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bad160-7f3d-445d-b9db-25635cfacfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1030405013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de31386b-40fa-4bed-a17a-ce0bbaafe97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec0b261db44414b8b31a4a51b4a9174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:19:16Z,use_quota=True,user_id='8ceb8e7a26b6447f903c976fbef99bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd547c8e-8ce0-4b12-ad87-274bccb6c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd547c8e-8ce0-4b12-ad87-274bccb6c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abeb141e-4899-47eb-b0fd-d26fda3cc027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:19:16 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4d883f-52b2-425b-aa2e-2ef2a924c725" returned: 0 in 0.336s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-quobyte-2c4d883f-52b2-425b-aa2e-2ef2a924c725" released by "delete_volume" :: held 0.898s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Created reservations ['b010278f-116a-402f-9ec9-98f23ff451ed', '7553354d-1f7d-44da-a06b-1ed8f9bae92e', '228f6125-cd7f-4c7c-9310-9d21d8a99bee', '534b8da0-09d7-474b-8ecd-0cade0d9b3a8'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:17 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:19:17 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "cinder-7d5a43e1-15b2-405a-aa34-474562479270-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-7d5a43e1-15b2-405a-aa34-474562479270-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "cinder-quobyte-7d5a43e1-15b2-405a-aa34-474562479270" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-quobyte-7d5a43e1-15b2-405a-aa34-474562479270" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6e420-0e12-4233-9ac3-cb3c211e6e89]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abeb141e-4899-47eb-b0fd-d26fda3cc027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de31386b-40fa-4bed-a17a-ce0bbaafe97a', 'volume_name': 'volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a27c85-2a93-4dc1-af89-f03747e4c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a27c85-2a93-4dc1-af89-f03747e4c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b4bd0a-c12f-459f-bb25-5cad1a2e0cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Volume de31386b-40fa-4bed-a17a-ce0bbaafe97a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Trying to clone de31386b-40fa-4bed-a17a-ce0bbaafe97a from image a5243768-15a1-4db8-a379-25d46ec5cd8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:19:17 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 Sep 12 07:19:17 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:17 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:19:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Deleted volume successfully. Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e6f06adc-45da-4ca0-9b3d-28505f55376f tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-2c4d883f-52b2-425b-aa2e-2ef2a924c725-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:19:17 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Image download 20.69 MB at 20.69 MB/s Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a449b-963f-4959-b438-007a1c8b021d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:17 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270" returned: 0 in 0.573s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:17 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270 Sep 12 07:19:17 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:17 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD Sep 12 07:19:17 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:18 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7d5a43e1-15b2-405a-aa34-474562479270" returned: 0 in 0.304s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-quobyte-7d5a43e1-15b2-405a-aa34-474562479270" released by "delete_volume" :: held 0.942s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Created reservations ['7a1dd1de-0102-4ef8-820e-212eedd032f9', '03edacef-b49c-4fbf-a1d9-f17163a3812f', 'd4822eac-e502-4553-8255-4fbfac852277', 'b0979210-21eb-41ec-93c3-4036d30a3601'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:19:18 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c is fetched for user 8ceb8e7a26b6447f903c976fbef99bd0. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:18 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:19:18 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[71561410-880a-424d-87f4-8677fe0c18a3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:18 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD Sep 12 07:19:18 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:18 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:19:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Deleted volume successfully. Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7efd56-5f22-4121-a4de-160278a4405c tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-7d5a43e1-15b2-405a-aa34-474562479270-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:18 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1030405013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de31386b-40fa-4bed-a17a-ce0bbaafe97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bec0b261db44414b8b31a4a51b4a9174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:19:16Z,use_quota=True,user_id='8ceb8e7a26b6447f903c976fbef99bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Creating volume de31386b-40fa-4bed-a17a-ce0bbaafe97a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:19:18 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:19:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:18 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a 1073741824 Sep 12 07:19:18 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:19 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a 1073741824" returned: 0 in 0.516s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:19 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a Sep 12 07:19:19 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "cinder-bea87f55-511a-42c2-a4f2-008014aa8446-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-bea87f55-511a-42c2-a4f2-008014aa8446-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "cinder-quobyte-bea87f55-511a-42c2-a4f2-008014aa8446" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-quobyte-bea87f55-511a-42c2-a4f2-008014aa8446" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a634f-2f73-48ff-a4da-2f75524c41d4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:19 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a" returned: 0 in 0.402s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:19 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 Sep 12 07:19:19 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Attempting download of a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume de31386b-40fa-4bed-a17a-ce0bbaafe97a. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61fed8b-a083-455d-a2c4-77bc5bb5c339]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:20 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl Sep 12 07:19:20 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:20 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446" returned: 0 in 0.434s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:20 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446 Sep 12 07:19:20 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:20 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl" returned: 0 in 0.414s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:20 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bea87f55-511a-42c2-a4f2-008014aa8446" returned: 0 in 0.310s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:20 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-quobyte-bea87f55-511a-42c2-a4f2-008014aa8446" released by "delete_volume" :: held 0.794s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:20 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Created reservations ['bcf52344-be09-486c-bd8f-ae40a6bb81d2', '8a280f2a-f80f-4188-87f5-306691829ee9', 'f714b01f-eb72-4404-9e19-6d0d0d3320d1', '416c4374-d11d-445b-b239-600921036a44'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:20 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:19:20 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:20 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl" returned: 1 in 0.457s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_urjzadpl' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607a275-d517-4c33-8249-41ababb4562b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:20 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD Sep 12 07:19:20 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:20 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.302s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:20 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:19:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Deleted volume successfully. Sep 12 07:19:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-488387b0-30e7-4923-a60a-a3743c3a3fb4 tempest-AttachVolumeTestJSON-380067606 None] Lock "cinder-bea87f55-511a-42c2-a4f2-008014aa8446-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:21 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:21 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] a5243768-15a1-4db8-a379-25d46ec5cd8c was qcow2, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:19:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:21 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a Sep 12 07:19:21 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Acquiring lock "cinder-9b1f545c-e1fc-4d37-9649-715d36abf305-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Lock "cinder-9b1f545c-e1fc-4d37-9649-715d36abf305-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Acquiring lock "cinder-quobyte-9b1f545c-e1fc-4d37-9649-715d36abf305" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Lock "cinder-quobyte-9b1f545c-e1fc-4d37-9649-715d36abf305" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c08681c-253a-454e-a494-caf85d454ca0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:23 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 Sep 12 07:19:23 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:23 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a" returned: 0 in 2.489s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_sgw07ptcdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:19:23 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Converted 112.00 MB image at 44.90 MB/s Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:23 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a 1G Sep 12 07:19:23 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:23 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305" returned: 0 in 0.500s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:23 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305 Sep 12 07:19:23 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:24 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9b1f545c-e1fc-4d37-9649-715d36abf305" returned: 0 in 0.323s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Lock "cinder-quobyte-9b1f545c-e1fc-4d37-9649-715d36abf305" released by "delete_volume" :: held 0.881s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:24 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a 1G" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Downloaded image a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume de31386b-40fa-4bed-a17a-ce0bbaafe97a successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c for user 8ceb8e7a26b6447f903c976fbef99bd0 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Marking volume de31386b-40fa-4bed-a17a-ce0bbaafe97a as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Copying metadata from image a5243768-15a1-4db8-a379-25d46ec5cd8c to de31386b-40fa-4bed-a17a-ce0bbaafe97a. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Creating volume glance metadata for volume de31386b-40fa-4bed-a17a-ce0bbaafe97a backed by image a5243768-15a1-4db8-a379-25d46ec5cd8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Created reservations ['368cb6b9-94f7-4a77-b469-17852f3e3f60', '45044345-3f88-48c0-88b1-4fde871ffacc', '110cd7b9-16e1-4dde-94de-212012046f9a', 'd956da04-6567-468a-b3b0-cfc625511a50'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b4bd0a-c12f-459f-bb25-5cad1a2e0cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da77508-ad97-44be-8a5b-605d61bd45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:19:24 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Volume volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a (de31386b-40fa-4bed-a17a-ce0bbaafe97a): created successfully Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da77508-ad97-44be-8a5b-605d61bd45db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Flow 'volume_create_manager' (7ffc3dee-3826-49bd-91ea-855c3d916a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-161caab4-1591-4c46-a502-bf91329e2518 tempest-ServerActionsTestOtherA-1429663845 None] Created volume successfully. Sep 12 07:19:24 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:19:24 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:24 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.287s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:19:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Deleted volume successfully. Sep 12 07:19:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-81b85f7f-84dc-4e4f-95dd-d24e501d3a40 tempest-VolumesNegativeTest-1860976928 None] Lock "cinder-9b1f545c-e1fc-4d37-9649-715d36abf305-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:19:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cd66dd16-80a6-43e1-b251-a78718e0ff87 req-7974a38b-e3c3-49d1-819d-cfea32bc8eb0 tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cd66dd16-80a6-43e1-b251-a78718e0ff87 req-7974a38b-e3c3-49d1-819d-cfea32bc8eb0 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cd66dd16-80a6-43e1-b251-a78718e0ff87 req-7974a38b-e3c3-49d1-819d-cfea32bc8eb0 tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-cd66dd16-80a6-43e1-b251-a78718e0ff87 req-7974a38b-e3c3-49d1-819d-cfea32bc8eb0 tempest-ServerActionsTestOtherA-1429663845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '903d1ec4-f910-49da-8c0d-359d5f27ed71', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:19:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-cd66dd16-80a6-43e1-b251-a78718e0ff87 req-7974a38b-e3c3-49d1-819d-cfea32bc8eb0 tempest-ServerActionsTestOtherA-1429663845 None] attachment_update completed successfully. Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:19:30 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:19:30 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:19:30 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.333s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:19:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:19:39 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=42,cinder:SELECT=36,cinder:INSERT=17,cinder:DELETE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:19:39 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=36,cinder:INSERT=13,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Flow 'volume_create_manager' (4aca5b9a-6796-4e2d-8c71-40fc2fa83cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec28ac1-c6da-4e2b-8e15-8f9ac9187f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec28ac1-c6da-4e2b-8e15-8f9ac9187f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-420200754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06732dd5-cd57-4fc8-8f0c-b02c1e669822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888c4874da3b4e5d8ae8009fc2726b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:10Z,use_quota=True,user_id='4e29e150ea0a4539b13ed750467962a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbb213a-ee6d-411d-b431-fadfaa05b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbb213a-ee6d-411d-b431-fadfaa05b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b51b58-0875-4177-ae37-105873dcc485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b51b58-0875-4177-ae37-105873dcc485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06732dd5-cd57-4fc8-8f0c-b02c1e669822', 'volume_name': 'volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce6deed-86b5-4632-bcfa-6a87fa291296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce6deed-86b5-4632-bcfa-6a87fa291296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3642664-09ff-40e8-8708-097b89baa240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Volume 06732dd5-cd57-4fc8-8f0c-b02c1e669822: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 12 07:20:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Trying to clone 06732dd5-cd57-4fc8-8f0c-b02c1e669822 from image a5243768-15a1-4db8-a379-25d46ec5cd8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:20:11 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:20:11 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Image download 20.69 MB at 20.69 MB/s Sep 12 07:20:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e8f6e1-51d1-44f7-a5cf-ecfc38269a9b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:12 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD Sep 12 07:20:12 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:12 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD" returned: 0 in 0.583s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:12 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c is fetched for user 4e29e150ea0a4539b13ed750467962a8. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:20:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a287e6a-73cf-4850-9a57-4fabbdbc0ef1]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:13 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD Sep 12 07:20:13 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:13 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD" returned: 0 in 1.152s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-420200754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06732dd5-cd57-4fc8-8f0c-b02c1e669822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888c4874da3b4e5d8ae8009fc2726b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:10Z,use_quota=True,user_id='4e29e150ea0a4539b13ed750467962a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Creating volume 06732dd5-cd57-4fc8-8f0c-b02c1e669822 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:13 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:14 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 1073741824 Sep 12 07:20:14 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:14 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 1073741824" returned: 0 in 0.726s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:14 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 Sep 12 07:20:14 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:15 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822" returned: 0 in 0.746s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:15 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Attempting download of a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume 06732dd5-cd57-4fc8-8f0c-b02c1e669822. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:20:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea7af0f-ffc3-41e5-a636-eee2089350e2]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:16 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1 Sep 12 07:20:16 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:16 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1" returned: 0 in 0.889s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:17 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1 Sep 12 07:20:17 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-e08b1b2b-1f6b-4f74-b89a-c458d3164b55 tempest-ServerActionsTestOtherA-1429663845 None] Terminate volume connection completed successfully. Sep 12 07:20:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-e08b1b2b-1f6b-4f74-b89a-c458d3164b55 tempest-ServerActionsTestOtherA-1429663845 None] Deleting attachment 903d1ec4-f910-49da-8c0d-359d5f27ed71. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:20:17 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1" returned: 1 in 0.962s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_68t8ibu1' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:20:17 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[802139e4-f906-4203-8630-213ff485d714]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:17 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD Sep 12 07:20:17 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:18 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD" returned: 0 in 0.583s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:18 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] a5243768-15a1-4db8-a379-25d46ec5cd8c was qcow2, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:20:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:18 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 Sep 12 07:20:18 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:20 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822" returned: 0 in 2.587s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:20 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_8wb21nv6devstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:20:20 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Converted 112.00 MB image at 43.23 MB/s Sep 12 07:20:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:20 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 1G Sep 12 07:20:20 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:21 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 1G" returned: 0 in 0.787s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Downloaded image a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume 06732dd5-cd57-4fc8-8f0c-b02c1e669822 successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c for user 4e29e150ea0a4539b13ed750467962a8 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Marking volume 06732dd5-cd57-4fc8-8f0c-b02c1e669822 as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Copying metadata from image a5243768-15a1-4db8-a379-25d46ec5cd8c to 06732dd5-cd57-4fc8-8f0c-b02c1e669822. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Creating volume glance metadata for volume 06732dd5-cd57-4fc8-8f0c-b02c1e669822 backed by image a5243768-15a1-4db8-a379-25d46ec5cd8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3642664-09ff-40e8-8708-097b89baa240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995decd5-40d7-4fe2-b68c-a35ebb092fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Volume volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 (06732dd5-cd57-4fc8-8f0c-b02c1e669822): created successfully Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995decd5-40d7-4fe2-b68c-a35ebb092fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Flow 'volume_create_manager' (4aca5b9a-6796-4e2d-8c71-40fc2fa83cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3c32da4b-3243-4ef5-b75e-2e74c46e0cc8 tempest-TestShelveInstance-763339690 None] Created volume successfully. Sep 12 07:20:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-19d86a60-624d-4bbc-8df0-095dec0e289b tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-19d86a60-624d-4bbc-8df0-095dec0e289b tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-19d86a60-624d-4bbc-8df0-095dec0e289b tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-19d86a60-624d-4bbc-8df0-095dec0e289b tempest-ServerActionsTestOtherA-1429663845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f51799b-e895-4954-8726-ba21c42030e1', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:20:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-161b01b4-d7ca-45ed-89bd-d4548917731e req-19d86a60-624d-4bbc-8df0-095dec0e289b tempest-ServerActionsTestOtherA-1429663845 None] attachment_update completed successfully. Sep 12 07:20:26 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (66d555ac-fa70-4f4a-a401-fb1edd1057f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfb39ad-45e7-4618-83f5-997aa8cac2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfb39ad-45e7-4618-83f5-997aa8cac2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1468088468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097246b8-9f78-4118-969b-58ab5d2fa511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:27Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c1d453-e43f-48c3-9a49-cd7056c062c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c1d453-e43f-48c3-9a49-cd7056c062c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae16a84-3ca1-46a3-b4c2-360139171921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae16a84-3ca1-46a3-b4c2-360139171921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097246b8-9f78-4118-969b-58ab5d2fa511', 'volume_name': 'volume-097246b8-9f78-4118-969b-58ab5d2fa511', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb77d8-48e7-4bfd-aa7c-db22c735d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb77d8-48e7-4bfd-aa7c-db22c735d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa0cca1-6dca-4e66-839c-65ad40d8b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:27 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Volume 097246b8-9f78-4118-969b-58ab5d2fa511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097246b8-9f78-4118-969b-58ab5d2fa511', 'volume_size': 1} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1468088468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097246b8-9f78-4118-969b-58ab5d2fa511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:27Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Creating volume 097246b8-9f78-4118-969b-58ab5d2fa511 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:27 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:27 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 1073741824 Sep 12 07:20:27 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:28 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 1073741824" returned: 0 in 1.228s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:28 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 Sep 12 07:20:28 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:28 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511" returned: 0 in 0.523s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa0cca1-6dca-4e66-839c-65ad40d8b764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097246b8-9f78-4118-969b-58ab5d2fa511', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82e5956-c4ac-402c-81eb-4331b2353d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:29 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Volume volume-097246b8-9f78-4118-969b-58ab5d2fa511 (097246b8-9f78-4118-969b-58ab5d2fa511): created successfully Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82e5956-c4ac-402c-81eb-4331b2353d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (66d555ac-fa70-4f4a-a401-fb1edd1057f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-71f7ce9c-cd58-4c10-b7a4-66a59fb2700d tempest-VolumesActionsTest-281905629 None] Created volume successfully. Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-8fa670c2-1d56-4b3c-b3fa-35c9b138b77a req-9beb8ef8-7b92-4754-80e0-a12e80706793 tempest-TestShelveInstance-763339690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-8fa670c2-1d56-4b3c-b3fa-35c9b138b77a req-9beb8ef8-7b92-4754-80e0-a12e80706793 tempest-TestShelveInstance-763339690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-8fa670c2-1d56-4b3c-b3fa-35c9b138b77a req-9beb8ef8-7b92-4754-80e0-a12e80706793 tempest-TestShelveInstance-763339690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-8fa670c2-1d56-4b3c-b3fa-35c9b138b77a req-9beb8ef8-7b92-4754-80e0-a12e80706793 tempest-TestShelveInstance-763339690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58b8d108-5868-4104-996b-4e8ca8754eeb', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:20:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-8fa670c2-1d56-4b3c-b3fa-35c9b138b77a req-9beb8ef8-7b92-4754-80e0-a12e80706793 tempest-TestShelveInstance-763339690 None] attachment_update completed successfully. Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e26aa92a-0b5b-489f-baa6-736ed65ce139 tempest-VolumesActionsTest-281905629 None] Acquiring lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511" by "attach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:30 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:20:30 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e26aa92a-0b5b-489f-baa6-736ed65ce139 tempest-VolumesActionsTest-281905629 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511" acquired by "attach_volume" :: waited 0.189s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e26aa92a-0b5b-489f-baa6-736ed65ce139 tempest-VolumesActionsTest-281905629 None] Attaching volume 097246b8-9f78-4118-969b-58ab5d2fa511 to instance 2fdc8a78-996d-4a84-b09d-52045d3bf632 at mountpoint /dev/vdb on host None. Sep 12 07:20:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e26aa92a-0b5b-489f-baa6-736ed65ce139 tempest-VolumesActionsTest-281905629 None] Attach volume completed successfully. Sep 12 07:20:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e26aa92a-0b5b-489f-baa6-736ed65ce139 tempest-VolumesActionsTest-281905629 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511" released by "attach_volume" :: held 0.354s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:31 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.602s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:20:31 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:20:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:20:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:20:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fce873a4-9ad8-4841-912a-b37ef5f765ce tempest-VolumesActionsTest-581385282 None] Terminate volume connection completed successfully. Sep 12 07:20:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fce873a4-9ad8-4841-912a-b37ef5f765ce tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-detach_volume" by "detach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fce873a4-9ad8-4841-912a-b37ef5f765ce tempest-VolumesActionsTest-581385282 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fce873a4-9ad8-4841-912a-b37ef5f765ce tempest-VolumesActionsTest-581385282 None] Detaching volume 097246b8-9f78-4118-969b-58ab5d2fa511 from instance 2fdc8a78-996d-4a84-b09d-52045d3bf632. Sep 12 07:20:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fce873a4-9ad8-4841-912a-b37ef5f765ce tempest-VolumesActionsTest-581385282 None] Detach volume completed successfully. Sep 12 07:20:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fce873a4-9ad8-4841-912a-b37ef5f765ce tempest-VolumesActionsTest-581385282 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-detach_volume" released by "detach_volume" :: held 0.166s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73baca12-f078-42b7-8584-2e0fbe7624a1 tempest-VolumesActionsTest-281905629 None] Acquiring lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-detach_volume" by "detach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73baca12-f078-42b7-8584-2e0fbe7624a1 tempest-VolumesActionsTest-281905629 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-73baca12-f078-42b7-8584-2e0fbe7624a1 tempest-VolumesActionsTest-281905629 None] Volume detach called, but volume not attached. Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73baca12-f078-42b7-8584-2e0fbe7624a1 tempest-VolumesActionsTest-281905629 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Acquiring lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Acquiring lock "cinder-quobyte-097246b8-9f78-4118-969b-58ab5d2fa511" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Lock "cinder-quobyte-097246b8-9f78-4118-969b-58ab5d2fa511" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e8195-ea7a-4e68-8c23-88efd177706c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:34 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 Sep 12 07:20:34 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:35 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511" returned: 0 in 0.971s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:35 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511 Sep 12 07:20:35 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:35 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097246b8-9f78-4118-969b-58ab5d2fa511" returned: 0 in 0.780s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Lock "cinder-quobyte-097246b8-9f78-4118-969b-58ab5d2fa511" released by "delete_volume" :: held 1.839s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Created reservations ['2ecab74e-8fc9-48b3-98d8-818c630eddad', '4c43e6e4-daaf-4985-9666-75dc66478417', '296fa04a-ae86-43e2-ab7b-ad139ee6eae4', '3bb16e14-ac33-4a27-92b3-3c02638fb10c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:36 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:20:36 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:37 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 1.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:38 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:20:38 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Deleted volume successfully. Sep 12 07:20:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a710f874-b501-4829-862d-580e6efe1670 tempest-VolumesActionsTest-281905629 None] Lock "cinder-097246b8-9f78-4118-969b-58ab5d2fa511-delete_volume" released by "delete_volume" :: held 4.241s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (ba315c46-3c19-4b85-897e-35f58e80ae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbe2321-8652-455b-981d-1647ea091a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbe2321-8652-455b-981d-1647ea091a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1219664829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02594ae0-aa9d-40f8-9246-a8f742b0c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:42Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a123476-ee29-483c-86b8-d17cffd10206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a123476-ee29-483c-86b8-d17cffd10206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898b1335-ddf0-4205-ba40-4c891fc79042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898b1335-ddf0-4205-ba40-4c891fc79042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02594ae0-aa9d-40f8-9246-a8f742b0c23c', 'volume_name': 'volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1f8736-daa7-4c05-82d5-45d0ef31d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1f8736-daa7-4c05-82d5-45d0ef31d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea06029-6bfe-4a4c-9c7c-de86d511d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Volume 02594ae0-aa9d-40f8-9246-a8f742b0c23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c', 'volume_size': 1} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1219664829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02594ae0-aa9d-40f8-9246-a8f742b0c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:42Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Creating volume 02594ae0-aa9d-40f8-9246-a8f742b0c23c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:42 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:42 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c 1073741824 Sep 12 07:20:42 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Flow 'volume_create_manager' (a22f13dc-00b5-41f9-bc73-61fc23f667f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9574e6da-9221-4ae9-be30-602e0af67773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9574e6da-9221-4ae9-be30-602e0af67773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-79871402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d899d33-80a2-4ff4-9fed-a7fdd67314b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f7591afd44c3aa12cd79a9b0850b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:43Z,use_quota=True,user_id='8580a7c415744c8a9039159ba0f53915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c358fbb9-0fe4-4e96-a9a1-06f9b82e15e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c358fbb9-0fe4-4e96-a9a1-06f9b82e15e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf51ec37-0af4-4e43-8446-e45159fbb492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf51ec37-0af4-4e43-8446-e45159fbb492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d899d33-80a2-4ff4-9fed-a7fdd67314b4', 'volume_name': 'volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dffa61-74ee-4dfa-88ee-543bf2c544a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dffa61-74ee-4dfa-88ee-543bf2c544a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3167cefc-2f08-4068-98c5-13fdff382c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:43 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Volume 2d899d33-80a2-4ff4-9fed-a7fdd67314b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4', 'volume_size': 1} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:43 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c 1073741824" returned: 0 in 0.986s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:43 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c Sep 12 07:20:43 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:44 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-79871402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d899d33-80a2-4ff4-9fed-a7fdd67314b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f7591afd44c3aa12cd79a9b0850b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:43Z,use_quota=True,user_id='8580a7c415744c8a9039159ba0f53915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Creating volume 2d899d33-80a2-4ff4-9fed-a7fdd67314b4 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:44 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea06029-6bfe-4a4c-9c7c-de86d511d89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:44 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 1073741824 Sep 12 07:20:44 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecb7101-292c-43b4-b800-e3a8c6140890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Volume volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c (02594ae0-aa9d-40f8-9246-a8f742b0c23c): created successfully Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecb7101-292c-43b4-b800-e3a8c6140890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (ba315c46-3c19-4b85-897e-35f58e80ae5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bf82494f-341d-412f-9127-ab4546aa4aaf tempest-VolumesActionsTest-281905629 None] Created volume successfully. Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-02594ae0-aa9d-40f8-9246-a8f742b0c23c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Lock "cinder-02594ae0-aa9d-40f8-9246-a8f742b0c23c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-quobyte-02594ae0-aa9d-40f8-9246-a8f742b0c23c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-02594ae0-aa9d-40f8-9246-a8f742b0c23c" acquired by "delete_volume" :: waited 0.036s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[96000700-63f6-497f-b201-4125b72a2885]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:45 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 1073741824" returned: 0 in 0.968s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:45 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c Sep 12 07:20:45 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:45 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 Sep 12 07:20:45 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:45 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3167cefc-2f08-4068-98c5-13fdff382c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac542b-6738-4193-bb3d-fe5117e234b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:45 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Volume volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 (2d899d33-80a2-4ff4-9fed-a7fdd67314b4): created successfully Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac542b-6738-4193-bb3d-fe5117e234b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Flow 'volume_create_manager' (a22f13dc-00b5-41f9-bc73-61fc23f667f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:45 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-00f505e0-dd5f-4ce0-99a7-35ed6981fb05 tempest-AttachVolumeNegativeTest-1632986707 None] Created volume successfully. Sep 12 07:20:45 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c" returned: 0 in 0.877s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:45 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c Sep 12 07:20:45 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:46 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-02594ae0-aa9d-40f8-9246-a8f742b0c23c" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-02594ae0-aa9d-40f8-9246-a8f742b0c23c" released by "delete_volume" :: held 1.297s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Created reservations ['60489e16-58c1-4f3c-aa63-9872a5b70036', 'ac775165-3548-4e5a-995e-9d93fc23b256', '8d523128-2a7c-47c2-8fdc-7a60e73e2ac5', '950d1789-04da-4850-a72b-3943d07e4d29'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:46 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:20:46 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:46 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.455s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:46 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:20:46 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Deleted volume successfully. Sep 12 07:20:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5cc3cc7a-aeca-438a-9a91-bf71288988bb tempest-VolumesActionsTest-581385282 None] Lock "cinder-02594ae0-aa9d-40f8-9246-a8f742b0c23c-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cc2f2f63-6670-4e6e-97cd-b6f29804a8dd req-6c951294-464e-488f-87fd-6669ca96f14d tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cc2f2f63-6670-4e6e-97cd-b6f29804a8dd req-6c951294-464e-488f-87fd-6669ca96f14d tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cc2f2f63-6670-4e6e-97cd-b6f29804a8dd req-6c951294-464e-488f-87fd-6669ca96f14d tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-cc2f2f63-6670-4e6e-97cd-b6f29804a8dd req-6c951294-464e-488f-87fd-6669ca96f14d tempest-AttachVolumeNegativeTest-1632986707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1f32125-8b43-4c55-ac48-572b28f4befb', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:20:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-cc2f2f63-6670-4e6e-97cd-b6f29804a8dd req-6c951294-464e-488f-87fd-6669ca96f14d tempest-AttachVolumeNegativeTest-1632986707 None] attachment_update completed successfully. Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (327dd978-67bc-478e-b986-c98e539a242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6329411b-1cd8-4bed-b797-06bdf8515408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6329411b-1cd8-4bed-b797-06bdf8515408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935737763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fd8a6f-e0d5-49bf-b310-163845cffec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:48Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1133cc7b-6afd-4e51-8927-4ded4c24dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1133cc7b-6afd-4e51-8927-4ded4c24dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92128d77-5126-4de8-afe8-75e953fcba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92128d77-5126-4de8-afe8-75e953fcba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fd8a6f-e0d5-49bf-b310-163845cffec5', 'volume_name': 'volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827ec1b3-12cd-4a94-b305-b784e15cdb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827ec1b3-12cd-4a94-b305-b784e15cdb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb4ee20-1a23-47ad-a6c1-3d841de581b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Volume a3fd8a6f-e0d5-49bf-b310-163845cffec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5', 'volume_size': 1} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935737763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fd8a6f-e0d5-49bf-b310-163845cffec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:48Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Creating volume a3fd8a6f-e0d5-49bf-b310-163845cffec5 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:48 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:48 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 1073741824 Sep 12 07:20:48 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:48 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 1073741824" returned: 0 in 0.607s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:48 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 Sep 12 07:20:48 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:49 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb4ee20-1a23-47ad-a6c1-3d841de581b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110eb02c-e45c-47cf-b15a-16dc21db2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Volume volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 (a3fd8a6f-e0d5-49bf-b310-163845cffec5): created successfully Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110eb02c-e45c-47cf-b15a-16dc21db2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (327dd978-67bc-478e-b986-c98e539a242b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-38798f6a-757b-4560-95d7-2fa92e3fdee7 tempest-VolumesActionsTest-281905629 None] Created volume successfully. Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-a3fd8a6f-e0d5-49bf-b310-163845cffec5-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Lock "cinder-a3fd8a6f-e0d5-49bf-b310-163845cffec5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-quobyte-a3fd8a6f-e0d5-49bf-b310-163845cffec5" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-a3fd8a6f-e0d5-49bf-b310-163845cffec5" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a9738-aae1-4418-ab6b-0c46af052006]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:50 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 Sep 12 07:20:50 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:50 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5" returned: 0 in 0.459s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:50 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5 Sep 12 07:20:50 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:51 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a3fd8a6f-e0d5-49bf-b310-163845cffec5" returned: 0 in 0.271s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-a3fd8a6f-e0d5-49bf-b310-163845cffec5" released by "delete_volume" :: held 0.795s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Created reservations ['f23d19a4-d15a-40c9-80a4-aab4244bd7ba', '1602bcc0-4463-4914-be5e-e7b3b86976a8', '4daaa1c5-218b-48a0-b067-46c60d028cc0', '3f7ad325-a6a5-4bf2-89b2-5b611ca29c78'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:51 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:20:51 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:51 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.407s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:20:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Deleted volume successfully. Sep 12 07:20:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-995309b1-d0c5-46b4-b1a1-79c7a1357ee4 tempest-VolumesActionsTest-581385282 None] Lock "cinder-a3fd8a6f-e0d5-49bf-b310-163845cffec5-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (9f79e231-2609-4d85-b42f-aa9bcf6a1957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbe99c2-694e-4231-a0cc-1af45d23daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbe99c2-694e-4231-a0cc-1af45d23daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-577163100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:52Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0c9b6f-faa2-46de-97e9-0806b7c8bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0c9b6f-faa2-46de-97e9-0806b7c8bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28932592-a737-4a64-9427-950f40e31041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28932592-a737-4a64-9427-950f40e31041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499', 'volume_name': 'volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f432324-9189-4bc3-b3be-0a3d21292c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f432324-9189-4bc3-b3be-0a3d21292c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c716b819-9461-4029-974f-8942e8a5269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:52 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Volume 2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499', 'volume_size': 1} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-577163100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:52Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Creating volume 2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:52 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:52 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 1073741824 Sep 12 07:20:52 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:52 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 1073741824" returned: 0 in 0.526s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:52 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 Sep 12 07:20:52 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:53 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499" returned: 0 in 0.316s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c716b819-9461-4029-974f-8942e8a5269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2666b8ba-e56b-4292-add8-873f8c1e66bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:53 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Volume volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 (2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499): created successfully Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2666b8ba-e56b-4292-add8-873f8c1e66bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (9f79e231-2609-4d85-b42f-aa9bcf6a1957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:53 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-23254504-6a0a-411e-b873-a814e64861f4 tempest-VolumesActionsTest-281905629 None] Created volume successfully. Sep 12 07:20:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Lock "cinder-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-quobyte-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:20:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499" acquired by "delete_volume" :: waited 0.036s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:20:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d79d30-f1bc-4af9-a55d-dc7303982055]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:20:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:55 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 Sep 12 07:20:55 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:55 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499" returned: 0 in 0.704s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:55 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499 Sep 12 07:20:55 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:55 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499" returned: 0 in 0.400s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499" released by "delete_volume" :: held 1.193s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Created reservations ['dc6e7a27-1b67-4fd9-89d8-b99c8ce904b2', '3f82fe62-ce8a-4d63-ad8e-874a375728bc', '5ac0d691-e6f3-4332-92c8-fcb4262601fe', 'a3f4889e-41d7-4d43-a569-46f26b1b84f7'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:56 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:20:56 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:56 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:20:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Deleted volume successfully. Sep 12 07:20:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7282d228-c003-4d13-b1b8-199a8d27ba77 tempest-VolumesActionsTest-581385282 None] Lock "cinder-2c4bd8fb-9c9d-48bc-8cca-40a2fccc7499-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (344e317e-ef94-44e4-a814-68d3f191cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0a8275-e36c-48f0-b5a7-59ac3f1d6027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0a8275-e36c-48f0-b5a7-59ac3f1d6027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350261588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018fc3cf-6c18-4c1f-939e-5ad29bcdc814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:58Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0ee4d9-c10c-4dc3-b7de-dfd06e49c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0ee4d9-c10c-4dc3-b7de-dfd06e49c416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57580359-b243-49ae-ace4-194f9b8792f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57580359-b243-49ae-ace4-194f9b8792f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018fc3cf-6c18-4c1f-939e-5ad29bcdc814', 'volume_name': 'volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4e5fe0-c8b5-447c-816e-dc6f38ff1b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4e5fe0-c8b5-447c-816e-dc6f38ff1b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fe0134-e1b5-4153-8f26-1278bc2b27df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:57 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Volume 018fc3cf-6c18-4c1f-939e-5ad29bcdc814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814', 'volume_size': 1} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350261588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018fc3cf-6c18-4c1f-939e-5ad29bcdc814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:20:58Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Creating volume 018fc3cf-6c18-4c1f-939e-5ad29bcdc814 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:20:57 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:20:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:57 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 1073741824 Sep 12 07:20:57 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:58 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 1073741824" returned: 0 in 0.715s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:20:58 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 Sep 12 07:20:58 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:20:59 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814" returned: 0 in 0.427s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fe0134-e1b5-4153-8f26-1278bc2b27df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1457501e-d2ee-4aca-b3da-4dda40f13ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:20:59 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Volume volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 (018fc3cf-6c18-4c1f-939e-5ad29bcdc814): created successfully Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1457501e-d2ee-4aca-b3da-4dda40f13ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:20:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (344e317e-ef94-44e4-a814-68d3f191cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:20:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-06dd679a-4102-4276-80ae-6fc945a71888 tempest-VolumesActionsTest-281905629 None] Created volume successfully. Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-018fc3cf-6c18-4c1f-939e-5ad29bcdc814-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Lock "cinder-018fc3cf-6c18-4c1f-939e-5ad29bcdc814-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Acquiring lock "cinder-quobyte-018fc3cf-6c18-4c1f-939e-5ad29bcdc814" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-018fc3cf-6c18-4c1f-939e-5ad29bcdc814" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1bc2fd-a03b-4c5b-ac5a-06be1fe85f7c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:00 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 Sep 12 07:21:00 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:00 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814" returned: 0 in 0.585s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:00 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814 Sep 12 07:21:00 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:01 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-018fc3cf-6c18-4c1f-939e-5ad29bcdc814" returned: 0 in 0.428s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Lock "cinder-quobyte-018fc3cf-6c18-4c1f-939e-5ad29bcdc814" released by "delete_volume" :: held 1.093s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Created reservations ['37cce90e-4da3-425b-ba56-59f94217be54', '1a1bcaf8-db6d-42b5-8b9b-a2888b3c519b', 'd1019ed8-8b52-4384-ac09-84d970c7212f', '378ebf4a-9ece-4384-9c22-3638bf0b8f53'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:01 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:01 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-34fab89c-87bb-4bc1-8f7a-66999c42520d tempest-ServerActionsTestOtherA-1429663845 None] Terminate volume connection completed successfully. Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-34fab89c-87bb-4bc1-8f7a-66999c42520d tempest-ServerActionsTestOtherA-1429663845 None] Deleting attachment 1f51799b-e895-4954-8726-ba21c42030e1. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:21:01 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Deleted volume successfully. Sep 12 07:21:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c139dae5-944d-4828-b71b-797baa338dbe tempest-VolumesActionsTest-581385282 None] Lock "cinder-018fc3cf-6c18-4c1f-939e-5ad29bcdc814-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "cinder-de31386b-40fa-4bed-a17a-ce0bbaafe97a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-de31386b-40fa-4bed-a17a-ce0bbaafe97a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "cinder-quobyte-de31386b-40fa-4bed-a17a-ce0bbaafe97a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-quobyte-de31386b-40fa-4bed-a17a-ce0bbaafe97a" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde61bc-67ef-4e77-9125-1b6f60c91d1d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:02 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a Sep 12 07:21:02 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:02 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a" returned: 0 in 0.594s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:02 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a Sep 12 07:21:02 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:03 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-de31386b-40fa-4bed-a17a-ce0bbaafe97a" returned: 0 in 0.409s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-quobyte-de31386b-40fa-4bed-a17a-ce0bbaafe97a" released by "delete_volume" :: held 1.089s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.quota [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Created reservations ['0ff58bf0-a695-434a-b536-eaa4a5bf7920', '6dfa3cc3-dcf0-4c3c-95e4-864afb1bceb8', '11ac472c-0d94-4895-b5e2-b094336079f8', '450735f6-9a41-44ab-bde5-8868d3c9b31c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (50e8cadf-b643-46ed-b46c-6ab301b7f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cb60d7-0e87-46dc-9a5d-45e3e37748d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cb60d7-0e87-46dc-9a5d-45e3e37748d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704475792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a2ea1-acbf-4276-b890-4eace637faba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:03Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41075056-3345-4066-8488-0d9135892ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41075056-3345-4066-8488-0d9135892ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf79109-15c2-4da0-9dae-08af77e24832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf79109-15c2-4da0-9dae-08af77e24832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9a2ea1-acbf-4276-b890-4eace637faba', 'volume_name': 'volume-9c9a2ea1-acbf-4276-b890-4eace637faba', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736f7afe-93a8-4950-97c0-801c51e8df94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736f7afe-93a8-4950-97c0-801c51e8df94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f7a12-126a-49d9-9854-514fa69243cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:03 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Volume 9c9a2ea1-acbf-4276-b890-4eace637faba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9a2ea1-acbf-4276-b890-4eace637faba', 'volume_size': 1} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704475792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a2ea1-acbf-4276-b890-4eace637faba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca75970c78748d1ad9b8f3e3c445341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:03Z,use_quota=True,user_id='2e0f8f62195649ad9f9902988706b00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Creating volume 9c9a2ea1-acbf-4276-b890-4eace637faba {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:03 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:03 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba 1073741824 Sep 12 07:21:03 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:03 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:03 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:03 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.manager [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:03 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Deleted volume successfully. Sep 12 07:21:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-5bcaa5cf-3072-4182-a3cb-1cc42583c7a2 req-530dc027-db38-4d2f-8620-e66b614b7a5e tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-de31386b-40fa-4bed-a17a-ce0bbaafe97a-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "cinder-a069e668-bd23-4ad1-9008-9a01657685bc-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-a069e668-bd23-4ad1-9008-9a01657685bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "cinder-quobyte-a069e668-bd23-4ad1-9008-9a01657685bc" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-quobyte-a069e668-bd23-4ad1-9008-9a01657685bc" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5151c-d898-42ea-82c0-298fa1bb976e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:04 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba 1073741824" returned: 0 in 0.732s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:04 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba Sep 12 07:21:04 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:04 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc Sep 12 07:21:04 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:04 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba" returned: 0 in 0.404s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f7a12-126a-49d9-9854-514fa69243cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9a2ea1-acbf-4276-b890-4eace637faba', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0558d744-0134-4223-8c1e-9623cb653c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:04 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Volume volume-9c9a2ea1-acbf-4276-b890-4eace637faba (9c9a2ea1-acbf-4276-b890-4eace637faba): created successfully Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0558d744-0134-4223-8c1e-9623cb653c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Flow 'volume_create_manager' (50e8cadf-b643-46ed-b46c-6ab301b7f839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-989092ca-a34d-4890-8486-07a4d2fb5877 tempest-VolumesActionsTest-281905629 None] Created volume successfully. Sep 12 07:21:04 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc" returned: 0 in 0.588s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:04 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc Sep 12 07:21:04 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:04 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a069e668-bd23-4ad1-9008-9a01657685bc" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-quobyte-a069e668-bd23-4ad1-9008-9a01657685bc" released by "delete_volume" :: held 0.906s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Created reservations ['28b225c8-f62f-4db2-8a57-8aac6b7b7f77', 'd04d0f09-3feb-4613-9505-0af61e18aeaa', 'f5bb3aec-1faa-4755-8ee1-6de3872d2e27', 'c386c02f-fcae-4d88-87e8-30e68181b71e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:05 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:05 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:05 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.497s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Deleted volume successfully. Sep 12 07:21:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-54da64ff-d21c-4ab4-b333-af8f61d83aef tempest-ServerActionsTestOtherA-1429663845 None] Lock "cinder-a069e668-bd23-4ad1-9008-9a01657685bc-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Acquiring lock "cinder-9c9a2ea1-acbf-4276-b890-4eace637faba-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Lock "cinder-9c9a2ea1-acbf-4276-b890-4eace637faba-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Acquiring lock "cinder-quobyte-9c9a2ea1-acbf-4276-b890-4eace637faba" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Lock "cinder-quobyte-9c9a2ea1-acbf-4276-b890-4eace637faba" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[44291cdb-6e74-44b9-8acb-efb27156f5b5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:07 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba Sep 12 07:21:07 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:07 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba" returned: 0 in 0.621s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:07 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba Sep 12 07:21:07 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:08 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c9a2ea1-acbf-4276-b890-4eace637faba" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Lock "cinder-quobyte-9c9a2ea1-acbf-4276-b890-4eace637faba" released by "delete_volume" :: held 1.067s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Created reservations ['50c233e1-7320-459b-87cf-c8aaba80e9f2', '280054d7-1bc2-4fc7-83ab-6b054d9fef45', 'c3832d21-feda-4309-a77f-811130efcbc3', 'd9af6cce-4888-4e3c-b5d9-75f36e3f1054'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:08 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:08 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:08 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Deleted volume successfully. Sep 12 07:21:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c9881dcf-ab71-4333-bef9-7bd5517f70e2 tempest-VolumesActionsTest-281905629 None] Lock "cinder-9c9a2ea1-acbf-4276-b890-4eace637faba-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:18 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=96,cinder:SELECT=97,cinder:INSERT=22,cinder:DELETE=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:21:18 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=89,cinder:INSERT=33,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:21:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-27550918-54eb-4b19-8c02-7ef369db1757 tempest-GroupSnapshotsV319Test-1741026870 None] Group tempest-GroupSnapshotsV319Test-Group-1641780721: creating Sep 12 07:21:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-27550918-54eb-4b19-8c02-7ef369db1757 tempest-GroupSnapshotsV319Test-1741026870 None] Group tempest-GroupSnapshotsV319Test-Group-1641780721: created successfully Sep 12 07:21:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-27550918-54eb-4b19-8c02-7ef369db1757 tempest-GroupSnapshotsV319Test-1741026870 None] Create group completed successfully. Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Flow 'volume_create_manager' (493aef55-37fb-4626-95be-658d7cd448e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecdc55d-215f-4d99-bd56-0b55ed56fccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecdc55d-215f-4d99-bd56-0b55ed56fccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88692503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=918f65a4-f3be-429d-accf-55c12ef025ab,host='devstack@QuobyteHD#QuobyteHD',id=c7403b24-bb90-4d14-bbdb-135dc4cfdae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccaf14c811482bbb75498c770061be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:21Z,use_quota=True,user_id='b346619241b24ba29442980a762c467b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edfb3326-9654-4bfa-bc23-f7c522f57b03),volume_type_id=edfb3326-9654-4bfa-bc23-f7c522f57b03)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38b6581-c26e-482b-a538-84e282418b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38b6581-c26e-482b-a538-84e282418b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75645443-d0ed-46f5-84f4-fb3eb2872171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75645443-d0ed-46f5-84f4-fb3eb2872171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7403b24-bb90-4d14-bbdb-135dc4cfdae2', 'volume_name': 'volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271bec9e-427a-4f08-8831-0a794572ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271bec9e-427a-4f08-8831-0a794572ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c387f591-1124-4a1d-aa1e-7763a9554451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Volume c7403b24-bb90-4d14-bbdb-135dc4cfdae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2', 'volume_size': 1} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=918f65a4-f3be-429d-accf-55c12ef025ab,created_at=2026-09-12T05:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88692503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=918f65a4-f3be-429d-accf-55c12ef025ab,host='devstack@QuobyteHD#QuobyteHD',id=c7403b24-bb90-4d14-bbdb-135dc4cfdae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccaf14c811482bbb75498c770061be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:21Z,use_quota=True,user_id='b346619241b24ba29442980a762c467b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edfb3326-9654-4bfa-bc23-f7c522f57b03),volume_type_id=edfb3326-9654-4bfa-bc23-f7c522f57b03)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Creating volume c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:21 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:21 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 1073741824 Sep 12 07:21:21 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:21 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 1073741824" returned: 0 in 0.474s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:21 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 Sep 12 07:21:21 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:22 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" returned: 0 in 0.309s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c387f591-1124-4a1d-aa1e-7763a9554451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585e1082-8fef-4950-8198-f20e0b1b5c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Volume volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 (c7403b24-bb90-4d14-bbdb-135dc4cfdae2): created successfully Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585e1082-8fef-4950-8198-f20e0b1b5c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Flow 'volume_create_manager' (493aef55-37fb-4626-95be-658d7cd448e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f1e572ba-437b-4e1d-a163-54f766c5879c tempest-GroupSnapshotsV319Test-1741026870 None] Created volume successfully. Sep 12 07:21:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] GroupSnapshot 3b138a90-646f-4cfa-989a-c2caffe16a26: creating. Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Group snapshot 3b138a90-646f-4cfa-989a-c2caffe16a26: creating. {{(pid=88013) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Creating offline snapshot bd7718dd-8b88-4b56-b537-0dc6d6937e17 of volume c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eb0c9f-d83e-4e6d-a36f-d57ee11ab9a6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:22 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 Sep 12 07:21:22 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:23 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" returned: 0 in 0.439s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:23 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 1G Sep 12 07:21:23 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:23 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 1G" returned: 0 in 0.494s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:23 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 Sep 12 07:21:23 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:24 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:24 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:21:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:24 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 Sep 12 07:21:24 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:24 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17" returned: 0 in 0.432s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:24 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info Sep 12 07:21:24 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:25 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info" returned: 0 in 0.611s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:25 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:21:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:25 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info Sep 12 07:21:25 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-e959cbf5-f430-4d1a-8464-3ac764b00dbe req-94054241-ee76-4000-b4e9-819dac08b27c tempest-TestShelveInstance-763339690 None] Terminate volume connection completed successfully. Sep 12 07:21:25 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-e959cbf5-f430-4d1a-8464-3ac764b00dbe req-94054241-ee76-4000-b4e9-819dac08b27c tempest-TestShelveInstance-763339690 None] Deleting attachment 58b8d108-5868-4104-996b-4e8ca8754eeb. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:21:25 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.info" returned: 0 in 0.450s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.978s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-72cd8489-8fff-4554-9568-49a40905f06c tempest-GroupSnapshotsV319Test-1741026870 None] group_snapshot 3b138a90-646f-4cfa-989a-c2caffe16a26: created successfully Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Flow 'volume_create_manager' (0069a4ad-28a9-4b6a-9ae1-06d79c543345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4260c4-7a9b-41a7-9974-e7e5a433b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:26 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] group_snapshot 3b138a90-646f-4cfa-989a-c2caffe16a26: deleting Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4260c4-7a9b-41a7-9974-e7e5a433b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2091239220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2935fa-5e4b-4431-a1c8-93cc12d42b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6601347029412fbcc692b5504492a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:26Z,use_quota=True,user_id='cee1c2d1ca4e40539e1da0e5eda001eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bee4e2-189b-41f8-96ab-e15ec377cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bee4e2-189b-41f8-96ab-e15ec377cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6e3edf-b31a-4a4a-87c4-2320f5e3e66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6e3edf-b31a-4a4a-87c4-2320f5e3e66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2935fa-5e4b-4431-a1c8-93cc12d42b09', 'volume_name': 'volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87411217-aabc-485f-a90e-0a61996b9e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87411217-aabc-485f-a90e-0a61996b9e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27258347-f9d1-44da-8d90-0c71e4d52086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:26 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Volume da2935fa-5e4b-4431-a1c8-93cc12d42b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09', 'volume_size': 1} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2091239220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2935fa-5e4b-4431-a1c8-93cc12d42b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6601347029412fbcc692b5504492a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:26Z,use_quota=True,user_id='cee1c2d1ca4e40539e1da0e5eda001eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Creating volume da2935fa-5e4b-4431-a1c8-93cc12d42b09 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:26 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:26 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 1073741824 Sep 12 07:21:26 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] group_snapshot 3b138a90-646f-4cfa-989a-c2caffe16a26: deleting {{(pid=88013) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "cinder-quobyte-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Lock "cinder-quobyte-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "cinder-quobyte-bd7718dd-8b88-4b56-b537-0dc6d6937e17" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Lock "cinder-quobyte-bd7718dd-8b88-4b56-b537-0dc6d6937e17" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Deleting offline snapshot bd7718dd-8b88-4b56-b537-0dc6d6937e17 of volume c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] snapshot_file for this snap is: volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[437cbdb8-5751-4cf7-861e-67d19ec399a7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:26 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 Sep 12 07:21:26 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:27 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 1073741824" returned: 0 in 0.577s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:27 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 Sep 12 07:21:27 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:27 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17" returned: 0 in 0.463s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7d8125-4261-4e5e-9e19-397ee2c9471e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:27 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09" returned: 0 in 0.299s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:27 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 Sep 12 07:21:27 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27258347-f9d1-44da-8d90-0c71e4d52086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a69597-73cf-4d02-8963-ec5088ff6ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:27 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Volume volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 (da2935fa-5e4b-4431-a1c8-93cc12d42b09): created successfully Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a69597-73cf-4d02-8963-ec5088ff6ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Flow 'volume_create_manager' (0069a4ad-28a9-4b6a-9ae1-06d79c543345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e8be6a73-005c-4be8-a689-a28bd1105bc5 tempest-VolumesListAdminTestJSON-1477593443 None] Created volume successfully. Sep 12 07:21:27 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" returned: 0 in 0.495s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:27 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 Sep 12 07:21:27 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:28 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17" returned: 0 in 0.523s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:28 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17 Sep 12 07:21:28 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:28 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2.bd7718dd-8b88-4b56-b537-0dc6d6937e17" returned: 0 in 0.439s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Lock "cinder-quobyte-bd7718dd-8b88-4b56-b537-0dc6d6937e17" released by "_delete_snapshot" :: held 2.108s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Lock "cinder-quobyte-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" released by "delete_snapshot" :: held 2.151s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:29 devstack cinder-volume[88013]: WARNING cinder.quota [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1355906919 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1355906919, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:21:29 devstack cinder-volume[88013]: WARNING cinder.quota [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1355906919 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1355906919, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] Created reservations ['73df2623-2a62-4904-8636-d3650a0e0424', '324c8486-d10a-4eb2-975f-3c05d88341b5', 'ecd4288c-5bc2-492f-974a-f0ebc8e9be3f', '35171d7a-ce67-4a08-b1c6-39ae972997a3'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-b0a306c2-dd12-4dca-b7db-8cbd8ac7fe5b req-c74fb1b1-7371-4400-b476-dd34e3992b2d tempest-TestShelveInstance-763339690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-b0a306c2-dd12-4dca-b7db-8cbd8ac7fe5b req-c74fb1b1-7371-4400-b476-dd34e3992b2d tempest-TestShelveInstance-763339690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-b0a306c2-dd12-4dca-b7db-8cbd8ac7fe5b req-c74fb1b1-7371-4400-b476-dd34e3992b2d tempest-TestShelveInstance-763339690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c8251fc1-9116-4240-bf62-245478fc7ac1 tempest-GroupSnapshotsV319Test-1741026870 None] group_snapshot 3b138a90-646f-4cfa-989a-c2caffe16a26: deleted successfully Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-b0a306c2-dd12-4dca-b7db-8cbd8ac7fe5b req-c74fb1b1-7371-4400-b476-dd34e3992b2d tempest-TestShelveInstance-763339690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16958c01-7e04-42a8-b331-315a16c51681', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:21:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-b0a306c2-dd12-4dca-b7db-8cbd8ac7fe5b req-c74fb1b1-7371-4400-b476-dd34e3992b2d tempest-TestShelveInstance-763339690 None] attachment_update completed successfully. Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Flow 'volume_create_manager' (ea279813-abb9-43e9-8ec3-789266164f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf9e795-6043-4100-af88-88326363e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf9e795-6043-4100-af88-88326363e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1536424874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6601347029412fbcc692b5504492a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:29Z,use_quota=True,user_id='cee1c2d1ca4e40539e1da0e5eda001eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08aef39e-6a11-4c0e-afab-58d2d3e86339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08aef39e-6a11-4c0e-afab-58d2d3e86339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f182cdf6-ae2c-4187-803c-4e2f5c958e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f182cdf6-ae2c-4187-803c-4e2f5c958e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660', 'volume_name': 'volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd72dfe1-4c97-4a8f-b714-8ece5ad2564c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd72dfe1-4c97-4a8f-b714-8ece5ad2564c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b414a9ac-95d2-4955-8646-1ab5569e4246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:29 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Volume bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660', 'volume_size': 1} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1536424874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6601347029412fbcc692b5504492a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:29Z,use_quota=True,user_id='cee1c2d1ca4e40539e1da0e5eda001eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Creating volume bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:29 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:29 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 1073741824 Sep 12 07:21:29 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:30 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 1073741824" returned: 0 in 0.546s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:30 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 Sep 12 07:21:30 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "cinder-quobyte-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:30 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Lock "cinder-quobyte-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" acquired by "delete_volume" :: waited 0.095s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:30 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:30 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660" returned: 0 in 0.433s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3f92d1-edbc-4cfd-8f02-194be41682e3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b414a9ac-95d2-4955-8646-1ab5569e4246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d2e404-54b3-432d-91c3-6e7f384db0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:30 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Volume volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 (bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660): created successfully Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d2e404-54b3-432d-91c3-6e7f384db0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Flow 'volume_create_manager' (ea279813-abb9-43e9-8ec3-789266164f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9ce7cdac-e4e0-4fb6-9c50-ff76deddadb9 tempest-VolumesListAdminTestJSON-1477593443 None] Created volume successfully. Sep 12 07:21:30 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 Sep 12 07:21:30 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:30 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.509s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:21:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:21:31 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" returned: 0 in 0.533s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:31 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2 Sep 12 07:21:31 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-3c173eba-d111-47c1-8be7-80444762aa6d req-bf11ce84-7068-4c96-b9cf-9fd2527f2f98 tempest-AttachVolumeNegativeTest-1632986707 None] Terminate volume connection completed successfully. Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-3c173eba-d111-47c1-8be7-80444762aa6d req-bf11ce84-7068-4c96-b9cf-9fd2527f2f98 tempest-AttachVolumeNegativeTest-1632986707 None] Deleting attachment b1f32125-8b43-4c55-ac48-572b28f4befb. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:21:31 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" returned: 0 in 0.342s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Lock "cinder-quobyte-c7403b24-bb90-4d14-bbdb-135dc4cfdae2" released by "delete_volume" :: held 1.032s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Created reservations ['f3747e3e-9434-42aa-9238-052973b9e5cd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:31 devstack cinder-volume[88013]: WARNING cinder.quota [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1355906919 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1355906919, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Created reservations ['63b475e0-392d-48db-a3f6-b5a8f02581ec', '922a96bb-622b-43e7-9f5f-6d7cc59f7065', '2dcad642-e149-4c63-8c7b-a8b8b172d655', 'd3a0d3c9-e3dd-4a71-a49a-a2337a8c7a38'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:31 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:31 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:32 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Flow 'volume_create_manager' (5a27ca27-9418-4b7f-a074-ab2d86af197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b560f80-e7a5-4059-baeb-a890420adfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.470s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a8f6832c-f0ca-4d9e-8997-0176b126815b tempest-GroupSnapshotsV319Test-1741026870 None] Delete group completed successfully. Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b560f80-e7a5-4059-baeb-a890420adfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2103239423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abfa825-5fe6-4af2-8a81-c9ac002f52d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6601347029412fbcc692b5504492a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:32Z,use_quota=True,user_id='cee1c2d1ca4e40539e1da0e5eda001eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d7fcad-9c6d-4c38-ac46-ae2a3802f209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d7fcad-9c6d-4c38-ac46-ae2a3802f209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff65e817-280b-404b-a02f-0fe7855b8172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff65e817-280b-404b-a02f-0fe7855b8172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abfa825-5fe6-4af2-8a81-c9ac002f52d3', 'volume_name': 'volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babcf0db-9964-45d2-8f2b-ff34fc1a81de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babcf0db-9964-45d2-8f2b-ff34fc1a81de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e956f1-d2e0-43fc-b7db-d2dd7a5e1398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:32 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Volume 4abfa825-5fe6-4af2-8a81-c9ac002f52d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3', 'volume_size': 1} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2103239423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abfa825-5fe6-4af2-8a81-c9ac002f52d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6601347029412fbcc692b5504492a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:32Z,use_quota=True,user_id='cee1c2d1ca4e40539e1da0e5eda001eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Creating volume 4abfa825-5fe6-4af2-8a81-c9ac002f52d3 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:32 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:32 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 1073741824 Sep 12 07:21:32 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:33 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 1073741824" returned: 0 in 1.026s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:33 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 Sep 12 07:21:33 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:34 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3" returned: 0 in 0.606s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e956f1-d2e0-43fc-b7db-d2dd7a5e1398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0071e856-e567-40d5-89ed-43f4fddc5339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:34 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Volume volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 (4abfa825-5fe6-4af2-8a81-c9ac002f52d3): created successfully Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0071e856-e567-40d5-89ed-43f4fddc5339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Flow 'volume_create_manager' (5a27ca27-9418-4b7f-a074-ab2d86af197b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-00d38304-a4b2-4ed6-bc89-e0ca54a2e1b5 tempest-VolumesListAdminTestJSON-1477593443 None] Created volume successfully. Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Flow 'volume_create_manager' (e233b3d9-11bb-482b-a205-fea6d8ff8e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d080731-3c7a-4b88-898c-5c583e4a1dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d080731-3c7a-4b88-898c-5c583e4a1dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e04a67-c209-459e-8e27-2c6d7f1ce018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb70cc40dad40e8acf1bc6cb140fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:36Z,use_quota=True,user_id='f2be51782e7b4652aea7aefa72b577c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798f1c8a-06ca-4ec4-8b02-cc34e3684da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798f1c8a-06ca-4ec4-8b02-cc34e3684da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78a3ee7-f30d-4b4e-b9c3-eb713aae3930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78a3ee7-f30d-4b4e-b9c3-eb713aae3930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e04a67-c209-459e-8e27-2c6d7f1ce018', 'volume_name': 'volume-15e04a67-c209-459e-8e27-2c6d7f1ce018', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a58986-f44c-43d4-897c-1781018e3066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a58986-f44c-43d4-897c-1781018e3066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad376e3f-d07e-43d6-a999-e6968c74cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:36 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Volume 15e04a67-c209-459e-8e27-2c6d7f1ce018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e04a67-c209-459e-8e27-2c6d7f1ce018', 'volume_size': 1} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e04a67-c209-459e-8e27-2c6d7f1ce018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb70cc40dad40e8acf1bc6cb140fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:36Z,use_quota=True,user_id='f2be51782e7b4652aea7aefa72b577c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Creating volume 15e04a67-c209-459e-8e27-2c6d7f1ce018 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:36 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:36 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 1073741824 Sep 12 07:21:36 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:37 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 1073741824" returned: 0 in 0.910s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:37 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 Sep 12 07:21:37 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:38 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018" returned: 0 in 0.444s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad376e3f-d07e-43d6-a999-e6968c74cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e04a67-c209-459e-8e27-2c6d7f1ce018', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53fb46f-6e7f-4ce7-bd54-2fb62013fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:38 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Volume volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 (15e04a67-c209-459e-8e27-2c6d7f1ce018): created successfully Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53fb46f-6e7f-4ce7-bd54-2fb62013fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Flow 'volume_create_manager' (e233b3d9-11bb-482b-a205-fea6d8ff8e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:38 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ae75571e-efc2-4b41-bc8c-3a2eb4fd9ff7 tempest-VolumesListAdminTestJSON-1521884634 None] Created volume successfully. Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Acquiring lock "cinder-15e04a67-c209-459e-8e27-2c6d7f1ce018-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "cinder-15e04a67-c209-459e-8e27-2c6d7f1ce018-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Acquiring lock "cinder-quobyte-15e04a67-c209-459e-8e27-2c6d7f1ce018" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "cinder-quobyte-15e04a67-c209-459e-8e27-2c6d7f1ce018" acquired by "delete_volume" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7cad8-f7b9-4fc0-b263-19de9dffa212]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "cinder-4abfa825-5fe6-4af2-8a81-c9ac002f52d3-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-4abfa825-5fe6-4af2-8a81-c9ac002f52d3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "cinder-quobyte-4abfa825-5fe6-4af2-8a81-c9ac002f52d3" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-quobyte-4abfa825-5fe6-4af2-8a81-c9ac002f52d3" acquired by "delete_volume" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:39 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 Sep 12 07:21:39 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5552b68d-1005-4e5b-bf85-1db850127bbe]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:39 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 Sep 12 07:21:39 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:39 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018" returned: 0 in 0.781s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:39 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3" returned: 0 in 0.587s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:39 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018 Sep 12 07:21:39 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:39 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3 Sep 12 07:21:39 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:40 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4abfa825-5fe6-4af2-8a81-c9ac002f52d3" returned: 0 in 0.387s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-quobyte-4abfa825-5fe6-4af2-8a81-c9ac002f52d3" released by "delete_volume" :: held 1.074s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:40 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15e04a67-c209-459e-8e27-2c6d7f1ce018" returned: 0 in 0.633s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Created reservations ['711a8db8-bde5-422c-8bf5-2854a3f7e47d', '1635b8cc-28d5-4d56-9910-2063fe47f2a5', '6632a506-f2b5-4408-9ff8-68d408b7353f', '8f209c0d-4652-4c5d-9357-0b759bc800cb'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "cinder-quobyte-15e04a67-c209-459e-8e27-2c6d7f1ce018" released by "delete_volume" :: held 1.499s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Created reservations ['b70e113a-bb33-4c29-9198-2c90728842b2', '575b372c-9c21-4661-b2d0-786bcc32a349', '1dc4ba26-e65c-4bbd-9d4f-584edbba8988', '3d4503eb-c009-4aec-ae38-7e514f372a6c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:40 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:40 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:40 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:40 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:41 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Deleted volume successfully. Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-00267530-dd6b-41dc-86ad-4e5d7a126d29 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-4abfa825-5fe6-4af2-8a81-c9ac002f52d3-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:41 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.375s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Deleted volume successfully. Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74546c06-f24a-4602-8aef-5f0a7a418512 tempest-VolumesListAdminTestJSON-1521884634 None] Lock "cinder-15e04a67-c209-459e-8e27-2c6d7f1ce018-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "cinder-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "cinder-quobyte-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-quobyte-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f014aa3-00a3-49ae-b09f-9a8df6695113]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:41 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 Sep 12 07:21:41 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:42 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660" returned: 0 in 0.484s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:42 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660 Sep 12 07:21:42 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:42 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660" returned: 0 in 0.333s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-quobyte-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660" released by "delete_volume" :: held 0.879s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Created reservations ['8b9dbbe2-6129-4b37-8bd8-b234f7557f54', '399167f7-041c-4c53-a26a-6b4fcec20ee8', '6faf8fac-c647-4ba7-a0e5-6896c06f203f', 'a5540c69-478d-49d7-bc85-972d2e530eac'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:42 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:42 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "cinder-da2935fa-5e4b-4431-a1c8-93cc12d42b09-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-da2935fa-5e4b-4431-a1c8-93cc12d42b09-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "cinder-quobyte-da2935fa-5e4b-4431-a1c8-93cc12d42b09" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-quobyte-da2935fa-5e4b-4431-a1c8-93cc12d42b09" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3278ab86-2138-4612-99dd-ed506e43e4c4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:43 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:43 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Deleted volume successfully. Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-66787c05-aa5f-4462-98ba-efb41cccf542 tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-bf7b5331-ff5a-4fd3-b5b6-ea7e22d3b660-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:43 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 Sep 12 07:21:43 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:43 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09" returned: 0 in 0.546s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:43 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09 Sep 12 07:21:43 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:44 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da2935fa-5e4b-4431-a1c8-93cc12d42b09" returned: 0 in 0.491s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-quobyte-da2935fa-5e4b-4431-a1c8-93cc12d42b09" released by "delete_volume" :: held 1.109s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Created reservations ['cdd5841d-be2f-452f-a910-2c1652cfd636', '5dca5ae3-5ca0-4abf-a25b-25e9461502e9', '8f6b0907-4515-4fb4-b537-0867ca78438f', '4060b14a-22e1-494b-ae7b-050dc397e798'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:44 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:21:44 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:44 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:21:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Deleted volume successfully. Sep 12 07:21:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-67b095ab-d0cc-43a9-8969-8e15744bf41b tempest-VolumesListAdminTestJSON-1477593443 None] Lock "cinder-da2935fa-5e4b-4431-a1c8-93cc12d42b09-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:21:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e45678eb-c6f4-448b-9934-de445646bb07 tempest-GroupsV314Test-1565573803 None] Group tempest-GroupsV314Test-Group-197242274: creating Sep 12 07:21:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e45678eb-c6f4-448b-9934-de445646bb07 tempest-GroupsV314Test-1565573803 None] Group tempest-GroupsV314Test-Group-197242274: created successfully Sep 12 07:21:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e45678eb-c6f4-448b-9934-de445646bb07 tempest-GroupsV314Test-1565573803 None] Create group completed successfully. Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Flow 'volume_create_manager' (ff76cb74-362d-43ec-bba7-36def3f2204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad63fd-a00a-4885-bcfc-be974e218708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad63fd-a00a-4885-bcfc-be974e218708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-635035651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b430b308-3858-4a63-bd00-4ec13425b181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cdd054cd114a12b4ecea8378b03723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:55Z,use_quota=True,user_id='a0bdf36ccbbc45ed8fae8249b40f51d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022ab601-e125-420a-85eb-8f680e056ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022ab601-e125-420a-85eb-8f680e056ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fa0f9d-32a1-4e7c-8771-5490f37bae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fa0f9d-32a1-4e7c-8771-5490f37bae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b430b308-3858-4a63-bd00-4ec13425b181', 'volume_name': 'volume-b430b308-3858-4a63-bd00-4ec13425b181', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f2a689-344c-4c06-ba0b-cf560dee32d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f2a689-344c-4c06-ba0b-cf560dee32d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1d6ab9-4b42-4f3c-964e-49600fc25f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Volume b430b308-3858-4a63-bd00-4ec13425b181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b430b308-3858-4a63-bd00-4ec13425b181', 'volume_size': 1} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-635035651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b430b308-3858-4a63-bd00-4ec13425b181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cdd054cd114a12b4ecea8378b03723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:55Z,use_quota=True,user_id='a0bdf36ccbbc45ed8fae8249b40f51d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Creating volume b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:54 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:54 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 1073741824 Sep 12 07:21:54 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:55 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 1073741824" returned: 0 in 0.623s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:55 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 Sep 12 07:21:55 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:55 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1d6ab9-4b42-4f3c-964e-49600fc25f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b430b308-3858-4a63-bd00-4ec13425b181', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d32bd3-340f-4917-99dc-6d40cbeb06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:55 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Volume volume-b430b308-3858-4a63-bd00-4ec13425b181 (b430b308-3858-4a63-bd00-4ec13425b181): created successfully Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d32bd3-340f-4917-99dc-6d40cbeb06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Flow 'volume_create_manager' (ff76cb74-362d-43ec-bba7-36def3f2204d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:55 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e9e8ab1d-3a67-42e0-be67-3013ead2b4ab tempest-VolumesDeleteCascade-1144263418 None] Created volume successfully. Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Flow 'volume_create_manager' (91442dc7-1ca9-460b-b8f7-c0a03a6dbec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f7bb7-7d8a-4dfe-b41f-adb760a94306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f7bb7-7d8a-4dfe-b41f-adb760a94306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471784527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d2c6e6e-36fe-463b-bca0-d4edd2acad61,host='devstack@QuobyteHD#QuobyteHD',id=74c82c61-8094-4e00-9f9e-1f4d2be5ecf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2086909a4947baae99d93b3361bab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:56Z,use_quota=True,user_id='17fa824613fe4d48aeba0c65f542cb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aef6e931-4465-490d-a41b-b746647d3b54),volume_type_id=aef6e931-4465-490d-a41b-b746647d3b54)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8573734-6429-48e1-b18a-7be53f34a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8573734-6429-48e1-b18a-7be53f34a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d274bcef-eebb-4f23-94d3-0ff80f15b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d274bcef-eebb-4f23-94d3-0ff80f15b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c82c61-8094-4e00-9f9e-1f4d2be5ecf7', 'volume_name': 'volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60362510-98fa-4eb2-bc54-1e92aa29cd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60362510-98fa-4eb2-bc54-1e92aa29cd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b0973e-bcae-4c9e-9af7-f16b3582be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:56 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Volume 74c82c61-8094-4e00-9f9e-1f4d2be5ecf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7', 'volume_size': 1} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d2c6e6e-36fe-463b-bca0-d4edd2acad61,created_at=2026-09-12T05:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471784527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d2c6e6e-36fe-463b-bca0-d4edd2acad61,host='devstack@QuobyteHD#QuobyteHD',id=74c82c61-8094-4e00-9f9e-1f4d2be5ecf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2086909a4947baae99d93b3361bab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:21:56Z,use_quota=True,user_id='17fa824613fe4d48aeba0c65f542cb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aef6e931-4465-490d-a41b-b746647d3b54),volume_type_id=aef6e931-4465-490d-a41b-b746647d3b54)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Creating volume 74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:21:56 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:56 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 1073741824 Sep 12 07:21:56 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:56 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 1073741824" returned: 0 in 0.427s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:56 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 Sep 12 07:21:56 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:56 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" returned: 0 in 0.272s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.023s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b0973e-bcae-4c9e-9af7-f16b3582be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b4d90d-9011-43a5-8244-0114e1402ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Creating offline snapshot f10bbc27-c50c-4182-85a5-d1d376f0a9ba of volume b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:21:56 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Volume volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 (74c82c61-8094-4e00-9f9e-1f4d2be5ecf7): created successfully Sep 12 07:21:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b4d90d-9011-43a5-8244-0114e1402ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Flow 'volume_create_manager' (91442dc7-1ca9-460b-b8f7-c0a03a6dbec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f4120-29aa-4f9a-9955-9afd04ee4f4b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2b09052d-b9b6-4af8-ab54-1b28c8c2e521 tempest-GroupsV314Test-1565573803 None] Created volume successfully. Sep 12 07:21:57 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 Sep 12 07:21:57 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:57 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:57 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba 1G Sep 12 07:21:57 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:57 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba 1G" returned: 0 in 0.541s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b430b308-3858-4a63-bd00-4ec13425b181 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:57 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b430b308-3858-4a63-bd00-4ec13425b181 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:21:57 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:21:58 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b430b308-3858-4a63-bd00-4ec13425b181 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.297s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:58 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba is being set with open permissions: ugo+rw Sep 12 07:21:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:58 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:21:58 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:58 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:58 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info Sep 12 07:21:58 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:58 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info" returned: 0 in 0.255s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:58 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info is being set with open permissions: ugo+rw Sep 12 07:21:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:58 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info Sep 12 07:21:58 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:59 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.info" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.034s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:21:59 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Cloning volume 74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 to volume 7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 Sep 12 07:21:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8faee618-3a65-4d22-b957-dbb8deeda488 tempest-VolumesDeleteCascade-1144263418 None] Create snapshot completed successfully Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Creating offline snapshot 2eebac39-b57d-4b9a-9b49-b524ffe422e2 of volume 74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de5a41a-6703-4f6b-bad1-2844c470127b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:59 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 Sep 12 07:21:59 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:59 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:21:59 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 1G Sep 12 07:21:59 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:21:59 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 1G" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:21:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:00 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 Sep 12 07:22:00 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:00 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:00 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:22:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:00 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 Sep 12 07:22:00 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:00 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2" returned: 0 in 0.331s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:00 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info Sep 12 07:22:00 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:01 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:01 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:01 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info Sep 12 07:22:01 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:01 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.info" returned: 0 in 0.273s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Acquiring lock "cinder-quobyte-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] snapshot: 2eebac39-b57d-4b9a-9b49-b524ffe422e2, volume: 7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fae4e7-2754-4db4-b10f-53b83dfa777d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:01 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 Sep 12 07:22:01 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:01 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45de833-f3e9-44b6-a607-e2c8ac88280d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:01 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 Sep 12 07:22:01 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:02 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" returned: 0 in 0.364s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:22:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:22:02 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:22:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:02 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 Sep 12 07:22:02 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:07 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" returned: 0 in 5.105s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:22:07 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Converted 1024.00 MB image at 200.54 MB/s Sep 12 07:22:07 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 is being set with open permissions: ugo+rw: NotImplementedError Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:07 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 Sep 12 07:22:07 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:07 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" released by "_copy_volume_from_snapshot" :: held 6.181s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Acquiring lock "cinder-quobyte-2eebac39-b57d-4b9a-9b49-b524ffe422e2" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-2eebac39-b57d-4b9a-9b49-b524ffe422e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Deleting offline snapshot 2eebac39-b57d-4b9a-9b49-b524ffe422e2 of volume 74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] snapshot_file for this snap is: volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a191c-4657-4646-bbc7-358a2d9cfa7c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:07 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 Sep 12 07:22:07 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:07 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2" returned: 0 in 0.338s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7993cbef-2406-4c7b-8442-7aa9e36e2d57]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:08 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 Sep 12 07:22:08 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:08 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" returned: 0 in 0.490s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:08 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 Sep 12 07:22:08 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:08 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2" returned: 0 in 0.331s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:08 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2 Sep 12 07:22:08 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:08 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7.2eebac39-b57d-4b9a-9b49-b524ffe422e2" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-2eebac39-b57d-4b9a-9b49-b524ffe422e2" released by "_delete_snapshot" :: held 1.479s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.645s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Creating offline snapshot c9ef165c-914f-4e6a-aa7f-d6955e3b9fad of volume b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797da68-9a99-4234-a0c0-5d0cd7510af2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6bbdaedb-3d15-4638-b413-8697065b0553 tempest-GroupsV314Test-1565573803 None] Create group from source-group-0d2c6e6e-36fe-463b-bca0-d4edd2acad61 completed successfully. Sep 12 07:22:09 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:22:09 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:09 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.344s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b430b308-3858-4a63-bd00-4ec13425b181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:09 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad 1G Sep 12 07:22:09 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:09 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad 1G" returned: 0 in 0.444s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:09 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad Sep 12 07:22:09 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Acquiring lock "cinder-quobyte-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b0d20-0c8d-46a6-9372-ea2cd1323cc0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:10 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" returned: 0 in 0.315s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:10 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad is being set with open permissions: ugo+rw Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:10 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 Sep 12 07:22:10 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:10 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad Sep 12 07:22:10 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:10 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:10 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.457s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:10 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3 Sep 12 07:22:10 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bda999b8-1f95-47c7-8ee7-98df80da34ec tempest-VolumesDeleteCascade-1144263418 None] Create snapshot completed successfully Sep 12 07:22:10 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-7b8c308a-dbeb-4e47-85d6-8c9a658b9fb3" released by "delete_volume" :: held 0.669s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Created reservations ['11ce1a21-b1e6-4387-b2cd-581b65cd3e67'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:10 devstack cinder-volume[88013]: WARNING cinder.quota [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-42683236 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-42683236, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:22:10 devstack cinder-volume[88013]: WARNING cinder.quota [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-42683236 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-42683236, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Created reservations ['393b94b7-fe0e-4808-99c6-226cbf85a6ce', 'c51257f7-2a31-4583-9b77-b9c4aab4e0a4', 'ee880e28-acb6-473d-80bc-03ffd6b779e9', 'b730f633-3d46-4262-9b45-17ec1a063ddc'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-b430b308-3858-4a63-bd00-4ec13425b181-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-b430b308-3858-4a63-bd00-4ec13425b181-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:10 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:10 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Performing cascade delete. {{(pid=88013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-c9ef165c-914f-4e6a-aa7f-d6955e3b9fad-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-c9ef165c-914f-4e6a-aa7f-d6955e3b9fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Deleting offline snapshot c9ef165c-914f-4e6a-aa7f-d6955e3b9fad of volume b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] snapshot_file for this snap is: volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[13041778-0493-4646-bbd7-911560515ec3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:11 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.268s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e9df9b5e-c439-415f-98e3-9bbac27d9a9a tempest-GroupsV314Test-1565573803 None] Delete group completed successfully. Sep 12 07:22:11 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad Sep 12 07:22:11 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:11 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b430b308-3858-4a63-bd00-4ec13425b181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Acquiring lock "cinder-quobyte-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed8f67-97ed-40a6-8748-a142404e7ebe]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" acquired by "delete_volume" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c1db64-5281-49c5-bf6d-91c2fb613360]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:11 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:22:11 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:11 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 Sep 12 07:22:11 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:11 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b430b308-3858-4a63-bd00-4ec13425b181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:12 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad Sep 12 07:22:12 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:12 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" returned: 0 in 0.383s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:12 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7 Sep 12 07:22:12 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:12 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Lock "cinder-quobyte-74c82c61-8094-4e00-9f9e-1f4d2be5ecf7" released by "delete_volume" :: held 0.733s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:12 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:12 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad Sep 12 07:22:12 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Created reservations ['c37f54a0-f750-4d5b-be61-fcb2a5e7ceab'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Created reservations ['7f74608e-b77e-4466-b7e5-4fcbb63a0d4d', '635f8820-6440-42b3-a862-e8daeeb7fc0f', '202abd5b-501d-4b22-8c15-cb5e8b23f42c', '104a3ffb-1580-4be2-8aba-2f9537c7b351'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:12 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:12 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:12 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" returned: 0 in 0.279s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-c9ef165c-914f-4e6a-aa7f-d6955e3b9fad" released by "_delete_snapshot" :: held 1.643s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" released by "delete_snapshot" :: held 1.667s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Created reservations ['24b2af9b-438e-4c96-b270-a7e3de6b4ee0', '2a666192-37b3-4f82-a046-016d0ba5f3a2', 'd76d7019-4a15-4964-85d9-b8daeca2c674', '49c463a2-bf54-45d1-b8e0-d7e7111fbad6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Delete snapshot completed successfully. Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-c9ef165c-914f-4e6a-aa7f-d6955e3b9fad-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-f10bbc27-c50c-4182-85a5-d1d376f0a9ba-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-f10bbc27-c50c-4182-85a5-d1d376f0a9ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:12 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.317s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-85f48c88-c689-4d26-ac30-cc262b9ea061 tempest-GroupsV314Test-1565573803 None] Delete group completed successfully. Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-f10bbc27-c50c-4182-85a5-d1d376f0a9ba" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-f10bbc27-c50c-4182-85a5-d1d376f0a9ba" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Deleting offline snapshot f10bbc27-c50c-4182-85a5-d1d376f0a9ba of volume b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] snapshot_file for this snap is: volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eb882d-728c-4c5b-b7d9-bc0700e76014]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:13 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:22:13 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:13 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.378s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b430b308-3858-4a63-bd00-4ec13425b181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c28ab-e690-414b-9093-ab7722286767]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:13 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 Sep 12 07:22:13 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:13 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181" returned: 0 in 0.384s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:13 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:22:13 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:14 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:14 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba Sep 12 07:22:14 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:14 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181.f10bbc27-c50c-4182-85a5-d1d376f0a9ba" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-f10bbc27-c50c-4182-85a5-d1d376f0a9ba" released by "_delete_snapshot" :: held 1.481s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" released by "delete_snapshot" :: held 1.515s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Created reservations ['27baaa7f-3b72-422a-8efa-2d815f4916d7', '57090eb9-a47f-4e58-a252-a75b76bc4e58', '76047af7-4ae7-44c4-b3a6-651e4f905086', '9872a6c5-0855-4ac8-b239-8acf98dac140'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Delete snapshot completed successfully. Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-f10bbc27-c50c-4182-85a5-d1d376f0a9ba-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Snapshots deleted, issuing volume delete {{(pid=88013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[562974f1-0335-4df8-a0ba-7caffbb8bab0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:14 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 Sep 12 07:22:14 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:15 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181" returned: 0 in 0.497s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:15 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181 Sep 12 07:22:15 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:15 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b430b308-3858-4a63-bd00-4ec13425b181" returned: 0 in 0.358s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-b430b308-3858-4a63-bd00-4ec13425b181" released by "delete_volume" :: held 0.949s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Created reservations ['cc36d81b-41b5-41f2-a4a2-d33c80fd189a', '5b24dc5e-a1f1-44b6-9c39-a4c169153f65', '15d7e9e1-6d76-48e2-98d3-3a3e54bf3e7e', 'f63c4c5b-e137-4560-94ba-0f58a2d93a39'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:15 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:15 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Flow 'volume_create_manager' (02c49249-ef13-4e69-9686-a9f5357f4871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354fb72c-0007-417e-a63f-6d5ea7e9b486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354fb72c-0007-417e-a63f-6d5ea7e9b486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-4971934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0500d66a-6aca-4f9a-b83f-16fb804b0969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f7591afd44c3aa12cd79a9b0850b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:16Z,use_quota=True,user_id='8580a7c415744c8a9039159ba0f53915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2343c9-94bd-459a-8fc6-e3681bf360ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2343c9-94bd-459a-8fc6-e3681bf360ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9684834f-b346-4dbe-8019-9cf174addd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9684834f-b346-4dbe-8019-9cf174addd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0500d66a-6aca-4f9a-b83f-16fb804b0969', 'volume_name': 'volume-0500d66a-6aca-4f9a-b83f-16fb804b0969', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87838b3-e964-4123-8173-c93f26ae7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87838b3-e964-4123-8173-c93f26ae7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f238df26-205a-487c-a946-62adf8a1987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Volume 0500d66a-6aca-4f9a-b83f-16fb804b0969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0500d66a-6aca-4f9a-b83f-16fb804b0969', 'volume_size': 1} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-4971934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0500d66a-6aca-4f9a-b83f-16fb804b0969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f7591afd44c3aa12cd79a9b0850b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:16Z,use_quota=True,user_id='8580a7c415744c8a9039159ba0f53915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Creating volume 0500d66a-6aca-4f9a-b83f-16fb804b0969 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:22:16 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:16 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:16 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 1073741824 Sep 12 07:22:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Deleted volume successfully. Sep 12 07:22:16 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-83a3200e-a7c3-4ad9-95e3-11c867728d1c tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-b430b308-3858-4a63-bd00-4ec13425b181-delete_volume" released by "delete_volume" :: held 5.332s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:17 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 1073741824" returned: 0 in 0.896s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:17 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 Sep 12 07:22:17 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:17 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969" returned: 0 in 0.339s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f238df26-205a-487c-a946-62adf8a1987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0500d66a-6aca-4f9a-b83f-16fb804b0969', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c662a45-fbdd-4fd4-a5d2-f6d7649043d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Volume volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 (0500d66a-6aca-4f9a-b83f-16fb804b0969): created successfully Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c662a45-fbdd-4fd4-a5d2-f6d7649043d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Flow 'volume_create_manager' (02c49249-ef13-4e69-9686-a9f5357f4871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-18fd6f96-7afa-40bf-bcd2-64fea7cfdeb6 tempest-AttachVolumeNegativeTest-1632986707 None] Created volume successfully. Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Flow 'volume_create_manager' (d463fc5a-3545-4f04-a6bf-81be80636f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6010d8e-f06e-4334-94a8-2fb8f86b475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6010d8e-f06e-4334-94a8-2fb8f86b475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435912171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef514325-5168-4bc0-895e-5598c81cf1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cdd054cd114a12b4ecea8378b03723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:18Z,use_quota=True,user_id='a0bdf36ccbbc45ed8fae8249b40f51d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b2050f-feda-4a45-8226-575a3179088c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b2050f-feda-4a45-8226-575a3179088c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649d6102-5148-4071-8a85-ebcb5bb5e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649d6102-5148-4071-8a85-ebcb5bb5e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef514325-5168-4bc0-895e-5598c81cf1cc', 'volume_name': 'volume-ef514325-5168-4bc0-895e-5598c81cf1cc', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a2ca56-f6aa-41b1-af67-802bd974b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a2ca56-f6aa-41b1-af67-802bd974b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af5f04f-6348-432f-9fa3-939ebb8be7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Volume ef514325-5168-4bc0-895e-5598c81cf1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef514325-5168-4bc0-895e-5598c81cf1cc', 'volume_size': 1} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435912171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef514325-5168-4bc0-895e-5598c81cf1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cdd054cd114a12b4ecea8378b03723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:18Z,use_quota=True,user_id='a0bdf36ccbbc45ed8fae8249b40f51d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Creating volume ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:22:18 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:18 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc 1073741824 Sep 12 07:22:18 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-971164d3-75e7-419b-94b6-a2b04d036e72 tempest-TestShelveInstance-763339690 None] Terminate volume connection completed successfully. Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-971164d3-75e7-419b-94b6-a2b04d036e72 tempest-TestShelveInstance-763339690 None] Deleting attachment 16958c01-7e04-42a8-b331-315a16c51681. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Acquiring lock "cinder-06732dd5-cd57-4fc8-8f0c-b02c1e669822-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Lock "cinder-06732dd5-cd57-4fc8-8f0c-b02c1e669822-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=125,cinder:SELECT=113,cinder:DELETE=9,cinder:INSERT=34 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Acquiring lock "cinder-quobyte-06732dd5-cd57-4fc8-8f0c-b02c1e669822" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Lock "cinder-quobyte-06732dd5-cd57-4fc8-8f0c-b02c1e669822" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0d03c1-a262-4956-b6be-357171df0e12]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:18 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc 1073741824" returned: 0 in 0.645s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=120,cinder:UPDATE=128,cinder:INSERT=25,cinder:DELETE=6 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:22:18 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 Sep 12 07:22:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:18 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:18 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc Sep 12 07:22:18 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:19 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822" returned: 0 in 0.598s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ce404838-22a9-4b31-86a0-2bf71bb6acfb req-aa8e98fb-ba14-4085-a854-32c7acde29c3 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:19 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc" returned: 0 in 0.446s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ce404838-22a9-4b31-86a0-2bf71bb6acfb req-aa8e98fb-ba14-4085-a854-32c7acde29c3 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:19 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822 Sep 12 07:22:19 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af5f04f-6348-432f-9fa3-939ebb8be7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef514325-5168-4bc0-895e-5598c81cf1cc', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf9d2ec-0fd1-4cb9-a679-7e60e7d7737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ce404838-22a9-4b31-86a0-2bf71bb6acfb req-aa8e98fb-ba14-4085-a854-32c7acde29c3 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Volume volume-ef514325-5168-4bc0-895e-5598c81cf1cc (ef514325-5168-4bc0-895e-5598c81cf1cc): created successfully Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf9d2ec-0fd1-4cb9-a679-7e60e7d7737c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Flow 'volume_create_manager' (d463fc5a-3545-4f04-a6bf-81be80636f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bd794d8d-586b-4bd5-8659-5116c4e4c8b4 tempest-VolumesDeleteCascade-1144263418 None] Created volume successfully. Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-ce404838-22a9-4b31-86a0-2bf71bb6acfb req-aa8e98fb-ba14-4085-a854-32c7acde29c3 tempest-AttachVolumeNegativeTest-1632986707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-0500d66a-6aca-4f9a-b83f-16fb804b0969', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad20f425-d15c-4a48-bae6-a16038e7efce', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:22:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-ce404838-22a9-4b31-86a0-2bf71bb6acfb req-aa8e98fb-ba14-4085-a854-32c7acde29c3 tempest-AttachVolumeNegativeTest-1632986707 None] attachment_update completed successfully. Sep 12 07:22:19 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-06732dd5-cd57-4fc8-8f0c-b02c1e669822" returned: 0 in 0.333s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Lock "cinder-quobyte-06732dd5-cd57-4fc8-8f0c-b02c1e669822" released by "delete_volume" :: held 0.996s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.quota [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Created reservations ['63ce3aea-0059-4e19-b13a-6a2e34439bbc', '0d2b5da3-1a1e-4526-b200-eaa6ada33a11', '2fe9fe61-b160-4e91-a731-d22f355fb1e4', '391c8b3c-4807-4d23-a894-f65a1df66f49'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:19 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:19 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:20 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.300s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.manager [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Deleted volume successfully. Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [req-8e850ab4-2078-4e95-bce7-7b68a547212f req-c379bdef-6994-4d9a-a7e1-1be984ac239d tempest-TestShelveInstance-763339690 None] Lock "cinder-06732dd5-cd57-4fc8-8f0c-b02c1e669822-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Creating offline snapshot 386a9d6c-a498-448c-8055-3cc5fc3b812e of volume ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa398825-7b3b-44f2-88e9-b0057c687eb8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:20 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc Sep 12 07:22:20 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:20 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:20 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e 1G Sep 12 07:22:20 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Flow 'volume_create_manager' (5bbe9088-735f-4f5f-979f-1138fe1f0573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158ed498-960b-4a45-8b78-2e4726726b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158ed498-960b-4a45-8b78-2e4726726b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1648958182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8db51c-0237-4e31-a8fa-de1aebd617f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe969544c9c485eb0c0c2037cb5d7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:21Z,use_quota=True,user_id='c5590c153c29448b9eeef2948541ad45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee406e5-8273-4095-914f-88e9baae3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee406e5-8273-4095-914f-88e9baae3592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64fc772-90bc-4e6a-acdc-e24fa7b45ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64fc772-90bc-4e6a-acdc-e24fa7b45ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8db51c-0237-4e31-a8fa-de1aebd617f7', 'volume_name': 'volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cc7960-79dd-419a-8c8f-81040edec29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cc7960-79dd-419a-8c8f-81040edec29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb06f5-9503-4765-ae7f-878d70ee43c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7', 'volume_size': 1} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:21 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e 1G" returned: 0 in 0.535s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef514325-5168-4bc0-895e-5598c81cf1cc -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:21 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef514325-5168-4bc0-895e-5598c81cf1cc -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e Sep 12 07:22:21 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:21 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef514325-5168-4bc0-895e-5598c81cf1cc -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:21 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e is being set with open permissions: ugo+rw Sep 12 07:22:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:21 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e Sep 12 07:22:21 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:22 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-2f711e4f-a372-4e5d-881d-409f7d1789ab req-1e873078-abc5-4ea0-879a-b79cb2529ec5 tempest-AttachVolumeNegativeTest-1632986707 None] Terminate volume connection completed successfully. Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-2f711e4f-a372-4e5d-881d-409f7d1789ab req-1e873078-abc5-4ea0-879a-b79cb2529ec5 tempest-AttachVolumeNegativeTest-1632986707 None] Deleting attachment ad20f425-d15c-4a48-bae6-a16038e7efce. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:22 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info Sep 12 07:22:22 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:22 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info" returned: 0 in 0.277s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:22 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info is being set with open permissions: ugo+rw Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:22 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info Sep 12 07:22:22 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:22 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.info" returned: 0 in 0.283s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1648958182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8db51c-0237-4e31-a8fa-de1aebd617f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe969544c9c485eb0c0c2037cb5d7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:21Z,use_quota=True,user_id='c5590c153c29448b9eeef2948541ad45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Creating volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:22:22 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:22:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:22 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 1073741824 Sep 12 07:22:22 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8503a61d-23eb-488f-93e9-7bc3cb638af7 tempest-VolumesDeleteCascade-1144263418 None] Create snapshot completed successfully Sep 12 07:22:23 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 1073741824" returned: 0 in 0.524s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:23 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 Sep 12 07:22:23 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:23 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7" returned: 0 in 0.459s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb06f5-9503-4765-ae7f-878d70ee43c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c7d693-0244-42dc-8acb-13f8a57a30cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Volume volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 (5c8db51c-0237-4e31-a8fa-de1aebd617f7): created successfully Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c7d693-0244-42dc-8acb-13f8a57a30cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Flow 'volume_create_manager' (5bbe9088-735f-4f5f-979f-1138fe1f0573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5f92e741-5535-4e9e-b537-5f4072d8b579 tempest-SnapshotsActionsTest-561584102 None] Created volume successfully. Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Flow 'volume_create_manager' (405fe4c0-31fe-4faf-84c9-a3c775f06a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1d004b-71b0-4548-8808-39853ba428a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Creating offline snapshot 1ec0a784-3b80-45c9-b640-58cfd3a0aed5 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1d004b-71b0-4548-8808-39853ba428a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2030681753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc6a241-c460-41da-b371-59c1a5f48f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cdd054cd114a12b4ecea8378b03723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=386a9d6c-a498-448c-8055-3cc5fc3b812e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:24Z,use_quota=True,user_id='a0bdf36ccbbc45ed8fae8249b40f51d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36096321-8809-4cc9-9a80-b1879d271cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36096321-8809-4cc9-9a80-b1879d271cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae551f8-bb24-4b60-a582-c6b83eea7f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae551f8-bb24-4b60-a582-c6b83eea7f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'edc6a241-c460-41da-b371-59c1a5f48f1f', 'volume_name': 'volume-edc6a241-c460-41da-b371-59c1a5f48f1f', 'volume_size': 1, 'snapshot_id': '386a9d6c-a498-448c-8055-3cc5fc3b812e'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7eddb96-5b09-4193-822e-a5b99ff8503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7eddb96-5b09-4193-822e-a5b99ff8503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f4231b-85c4-4946-8e34-0792e5949b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:24 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Volume edc6a241-c460-41da-b371-59c1a5f48f1f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-edc6a241-c460-41da-b371-59c1a5f48f1f', 'volume_size': 1, 'snapshot_id': '386a9d6c-a498-448c-8055-3cc5fc3b812e'} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d4d80c-2c57-49a8-9be8-246090f00c42]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:24 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 Sep 12 07:22:24 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:25 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7" returned: 0 in 0.530s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:25 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 1G Sep 12 07:22:25 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:25 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 1G" returned: 0 in 0.589s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:25 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:25 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:26 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.363s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:26 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 is being set with open permissions: ugo+rw Sep 12 07:22:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:26 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:26 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:26 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:26 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info Sep 12 07:22:26 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:26 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info" returned: 0 in 0.292s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:26 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info is being set with open permissions: ugo+rw Sep 12 07:22:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:26 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info Sep 12 07:22:26 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:27 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.info" returned: 0 in 0.280s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.378s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-386a9d6c-a498-448c-8055-3cc5fc3b812e-edc6a241-c460-41da-b371-59c1a5f48f1f" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-386a9d6c-a498-448c-8055-3cc5fc3b812e-edc6a241-c460-41da-b371-59c1a5f48f1f" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Creating volume edc6a241-c460-41da-b371-59c1a5f48f1f from snapshot 386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-edc6a241-c460-41da-b371-59c1a5f48f1f" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ab7a5e27-b135-4ef3-98cd-5d8c040874a6 tempest-SnapshotsActionsTest-561584102 None] Create snapshot completed successfully Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-edc6a241-c460-41da-b371-59c1a5f48f1f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] snapshot: 386a9d6c-a498-448c-8055-3cc5fc3b812e, volume: edc6a241-c460-41da-b371-59c1a5f48f1f, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee04d4-07a6-4403-b401-15196a4c00c4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:27 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e Sep 12 07:22:27 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:27 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e" returned: 0 in 0.402s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef514325-5168-4bc0-895e-5598c81cf1cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2754e5-1629-4a5a-ba5f-edddf4a8fb1d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:27 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc Sep 12 07:22:27 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:28 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc" returned: 0 in 0.494s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:22:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:22:28 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:22:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:28 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f Sep 12 07:22:28 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:30 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:30 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:31 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.698s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:31 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:22:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:22:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:22:33 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f" returned: 0 in 5.213s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:22:33 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Converted 1024.00 MB image at 196.33 MB/s Sep 12 07:22:33 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f is being set with open permissions: ugo+rw Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:33 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f Sep 12 07:22:33 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:33 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f" returned: 0 in 0.264s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-edc6a241-c460-41da-b371-59c1a5f48f1f" released by "_copy_volume_from_snapshot" :: held 6.474s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-386a9d6c-a498-448c-8055-3cc5fc3b812e-edc6a241-c460-41da-b371-59c1a5f48f1f" released by "_create_volume_from_snapshot" :: held 6.550s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.580s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.220s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Creating offline snapshot 9d9e9421-00ad-4ebc-aea3-bd04d8777b9f of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[87904e1a-1b3b-4270-a4ad-915c4112e48b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f4231b-85c4-4946-8e34-0792e5949b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc6a241-c460-41da-b371-59c1a5f48f1f', 'volume_size': 1, 'snapshot_id': '386a9d6c-a498-448c-8055-3cc5fc3b812e'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbddc80-f208-4277-b257-05b02cfe29ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:33 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Volume volume-edc6a241-c460-41da-b371-59c1a5f48f1f (edc6a241-c460-41da-b371-59c1a5f48f1f): created successfully Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbddc80-f208-4277-b257-05b02cfe29ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Flow 'volume_create_manager' (405fe4c0-31fe-4faf-84c9-a3c775f06a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e1eb7beb-dd48-427e-bce6-c625214a8dd8 tempest-VolumesDeleteCascade-1144263418 None] Created volume successfully. Sep 12 07:22:33 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:33 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:34 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.490s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:34 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f 1G Sep 12 07:22:34 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-ef514325-5168-4bc0-895e-5598c81cf1cc-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-ef514325-5168-4bc0-895e-5598c81cf1cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Performing cascade delete. {{(pid=88013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-386a9d6c-a498-448c-8055-3cc5fc3b812e-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-386a9d6c-a498-448c-8055-3cc5fc3b812e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-ef514325-5168-4bc0-895e-5598c81cf1cc" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-ef514325-5168-4bc0-895e-5598c81cf1cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-386a9d6c-a498-448c-8055-3cc5fc3b812e" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-386a9d6c-a498-448c-8055-3cc5fc3b812e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Deleting offline snapshot 386a9d6c-a498-448c-8055-3cc5fc3b812e of volume ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] snapshot_file for this snap is: volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83ba022-eaa1-4e7d-b031-7a91ec357b95]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:34 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f 1G" returned: 0 in 0.621s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:34 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f Sep 12 07:22:34 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:34 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e Sep 12 07:22:34 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:35 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e" returned: 0 in 0.524s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef514325-5168-4bc0-895e-5598c81cf1cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:35 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" returned: 0 in 0.519s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:35 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f is being set with open permissions: ugo+rw Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f8bc14-ed72-47c8-baf4-f39605578513]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:35 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f Sep 12 07:22:35 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:35 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc Sep 12 07:22:35 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:35 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" returned: 0 in 0.301s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f0059685-10cb-425a-a083-84c67f20a6f8 tempest-SnapshotsActionsTest-561584102 None] Create snapshot completed successfully Sep 12 07:22:36 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc" returned: 0 in 0.671s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:36 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e Sep 12 07:22:36 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-9d9e9421-00ad-4ebc-aea3-bd04d8777b9f-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-9d9e9421-00ad-4ebc-aea3-bd04d8777b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Deleting offline snapshot 9d9e9421-00ad-4ebc-aea3-bd04d8777b9f of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] snapshot_file for this snap is: volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2be46-333b-4e99-b4d0-f1ffc4484148]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:36 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f Sep 12 07:22:36 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:36 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e" returned: 0 in 0.584s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:36 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e Sep 12 07:22:36 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:36 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" returned: 0 in 0.575s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:37 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc.386a9d6c-a498-448c-8055-3cc5fc3b812e" returned: 0 in 0.392s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98eebe2-3b9b-49fe-b8fb-1183b1eaa89b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-386a9d6c-a498-448c-8055-3cc5fc3b812e" released by "_delete_snapshot" :: held 2.360s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-ef514325-5168-4bc0-895e-5598c81cf1cc" released by "delete_snapshot" :: held 2.400s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Created reservations ['ff81bf76-adc9-4db6-8440-5555205609b2', '1e3b96b4-6c3b-4c7c-adfa-ffd7fa2af907', 'de2e5c94-bd9b-4b8a-b585-f54b8c2caad4', '7ee12bf6-0528-4a57-9677-d1862f10f91d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:37 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Delete snapshot completed successfully. Sep 12 07:22:37 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-386a9d6c-a498-448c-8055-3cc5fc3b812e-delete_snapshot" released by "delete_snapshot" :: held 2.657s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Snapshots deleted, issuing volume delete {{(pid=88013) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-ef514325-5168-4bc0-895e-5598c81cf1cc" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-ef514325-5168-4bc0-895e-5598c81cf1cc" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6f6ad0-9f11-490a-b119-1f6ed6435789]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:37 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc Sep 12 07:22:37 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:37 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.696s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:37 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f Sep 12 07:22:37 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:38 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc" returned: 0 in 0.662s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:38 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc Sep 12 07:22:38 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:38 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" returned: 0 in 0.561s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:38 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f Sep 12 07:22:38 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:38 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef514325-5168-4bc0-895e-5598c81cf1cc" returned: 0 in 0.365s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-ef514325-5168-4bc0-895e-5598c81cf1cc" released by "delete_volume" :: held 1.123s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Created reservations ['34478913-74fc-4f64-91ae-34525b1e1ebf', '2a8dc09b-897b-4730-8921-d6dcd591be01', '66016237-10f3-4b82-a5f8-4a7135791f4b', '0257b7c3-a08b-44bd-aa76-4d6d4a969708'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:38 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:38 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:38 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-9d9e9421-00ad-4ebc-aea3-bd04d8777b9f" released by "_delete_snapshot" :: held 2.399s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" released by "delete_snapshot" :: held 2.433s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Created reservations ['b53d2373-b8b2-49d5-8c08-1f7ff9273c11', '0b404842-a31f-42af-8efd-7e4931a79fe8', '6058090a-a3de-4e22-962d-e86251c76062', '2404fefd-254b-4a43-b2e3-cb380ab83dbe'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:38 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Delete snapshot completed successfully. Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-495a6586-6f61-44b1-9fd0-201afc23340b tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-9d9e9421-00ad-4ebc-aea3-bd04d8777b9f-delete_snapshot" released by "delete_snapshot" :: held 2.622s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:38 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:38 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:38 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Deleted volume successfully. Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bf007f5-fa6e-444d-b7ac-956235e35509 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-ef514325-5168-4bc0-895e-5598c81cf1cc-delete_volume" released by "delete_volume" :: held 4.406s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-edc6a241-c460-41da-b371-59c1a5f48f1f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-edc6a241-c460-41da-b371-59c1a5f48f1f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "cinder-quobyte-edc6a241-c460-41da-b371-59c1a5f48f1f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-edc6a241-c460-41da-b371-59c1a5f48f1f" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bf71cd-2a30-43b0-945e-e40eb9e4d433]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:39 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f Sep 12 07:22:39 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:40 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Creating offline snapshot d28a4e28-4e3b-4e29-b539-5c487f8cd165 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f" returned: 0 in 1.078s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e6f08-1dbb-4c6d-b3ed-998d706b0490]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:40 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f Sep 12 07:22:40 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:40 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:40 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:41 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-edc6a241-c460-41da-b371-59c1a5f48f1f" returned: 0 in 0.558s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-quobyte-edc6a241-c460-41da-b371-59c1a5f48f1f" released by "delete_volume" :: held 1.711s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Created reservations ['2f7f56bd-510e-4c87-bc15-0e3bc5a6dcc8', 'ec555438-79ee-42f3-9abb-57afc420c656', '31674fb1-19dc-4680-a7ab-0b120dd9e53c', '612784ea-f29d-4cc2-8f46-150c4a976812'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:41 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.740s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:41 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 1G Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:41 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:41 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:41 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:41 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.414s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Deleted volume successfully. Sep 12 07:22:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb9e87eb-4414-4d0f-ab61-3ea64739c351 tempest-VolumesDeleteCascade-1144263418 None] Lock "cinder-edc6a241-c460-41da-b371-59c1a5f48f1f-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:42 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 1G" returned: 0 in 0.827s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:42 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 Sep 12 07:22:42 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:42 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:42 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 is being set with open permissions: ugo+rw Sep 12 07:22:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:42 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 Sep 12 07:22:42 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:42 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165" returned: 0 in 0.384s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:43 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-40f32e3e-f080-4fb2-8b46-c45ad26c6433 tempest-SnapshotsActionsTest-561584102 None] Create snapshot completed successfully Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-d28a4e28-4e3b-4e29-b539-5c487f8cd165-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-d28a4e28-4e3b-4e29-b539-5c487f8cd165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-d28a4e28-4e3b-4e29-b539-5c487f8cd165" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-d28a4e28-4e3b-4e29-b539-5c487f8cd165" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Deleting offline snapshot d28a4e28-4e3b-4e29-b539-5c487f8cd165 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] snapshot_file for this snap is: volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a380e60-c08c-42d8-9771-54e13d363456]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:44 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 Sep 12 07:22:44 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:44 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165" returned: 0 in 0.742s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:44 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d86d36-ca25-47d5-97f1-ed78e7d1ae59]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:44 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:44 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:45 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.596s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:45 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 Sep 12 07:22:45 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Flow 'volume_create_manager' (6073b55f-5dec-4908-ac91-6a2204b6ab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1be732-ce02-42d1-b608-2a4e6ec9c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1be732-ce02-42d1-b608-2a4e6ec9c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3797a0-9b6a-4b2b-94d6-65d4e325e822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602d119139e47a3a916cf28141a6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:46Z,use_quota=True,user_id='b8a86426d3d94a7ca4633e20fff1d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424b1126-36ed-4f7d-9f39-6dced3bf37f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424b1126-36ed-4f7d-9f39-6dced3bf37f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7407b2fb-ee74-40bc-b57b-a13e12988682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:45 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:22:46 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165" returned: 0 in 0.680s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:46 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165 Sep 12 07:22:46 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:46 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.d28a4e28-4e3b-4e29-b539-5c487f8cd165" returned: 0 in 0.303s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-d28a4e28-4e3b-4e29-b539-5c487f8cd165" released by "_delete_snapshot" :: held 2.474s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" released by "delete_snapshot" :: held 2.519s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7407b2fb-ee74-40bc-b57b-a13e12988682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f3797a0-9b6a-4b2b-94d6-65d4e325e822', 'volume_name': 'volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822', 'volume_size': 1, 'image_id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df054a14948220694227735656566175', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7602d119139e47a3a916cf28141a6207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe740d07044f366969f45d5bda932238c1ee66e85d9b08bdeefef3a922aa7052b5faea451937ea1cde25f8b3ed95981bcc7bcfcaf6a1d64d855d8d018b9bbc2b', 'id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'created_at': datetime.datetime(2026, 9, 12, 5, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 22, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1/file', 'properties': {}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8b7860-77e5-4f4d-a24e-3062ee6741aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8b7860-77e5-4f4d-a24e-3062ee6741aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77bd427f-cbde-4063-bd7b-d26b75f5679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Volume 7f3797a0-9b6a-4b2b-94d6-65d4e325e822: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822', 'volume_size': 1, 'image_id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df054a14948220694227735656566175', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7602d119139e47a3a916cf28141a6207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe740d07044f366969f45d5bda932238c1ee66e85d9b08bdeefef3a922aa7052b5faea451937ea1cde25f8b3ed95981bcc7bcfcaf6a1d64d855d8d018b9bbc2b', 'id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'created_at': datetime.datetime(2026, 9, 12, 5, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 22, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1/file', 'properties': {}}, 'image_service': } Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Trying to clone 7f3797a0-9b6a-4b2b-94d6-65d4e325e822 from image 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Created reservations ['2a373638-49f0-4c14-9051-e5dff26affa7', 'f98d4a3f-1744-4366-8de2-1e826a1311d8', 'b76db88c-9abd-4986-8c2d-8fb7360a0eee', '258ebbf7-5d0f-4483-b573-83883a66e2bd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:46 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Delete snapshot completed successfully. Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:22:46 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Image download 0.00 MB at 0.00 MB/s Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0df8dc25-b6d1-4c6a-9e0f-856e3c293e63 tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-d28a4e28-4e3b-4e29-b539-5c487f8cd165-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39710d-932c-4845-a89c-877e477e9d00]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:46 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD Sep 12 07:22:46 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:47 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:47 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD Sep 12 07:22:47 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:47 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD" returned: 1 in 0.443s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Temporary image 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 is fetched for user b8a86426d3d94a7ca4633e20fff1d4cf. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33be9b-1cd1-4b66-9af1-0ab27964d64f]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Creating offline snapshot 0f778a15-7c68-422f-893e-cf6b5f001063 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dfbfa3-412d-406a-bce5-95bf33bf0a0e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:47 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD Sep 12 07:22:47 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:48 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:48 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:48 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD" returned: 0 in 0.536s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:48 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD Sep 12 07:22:48 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:48 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.647s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:48 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 1G Sep 12 07:22:48 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:48 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD" returned: 1 in 0.540s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:48 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 1G" returned: 0 in 0.499s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:48 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 Sep 12 07:22:48 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:49 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063" returned: 0 in 0.341s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:49 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 is being set with open permissions: ugo+rw Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:49 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 Sep 12 07:22:49 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:49 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3797a0-9b6a-4b2b-94d6-65d4e325e822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602d119139e47a3a916cf28141a6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:22:46Z,use_quota=True,user_id='b8a86426d3d94a7ca4633e20fff1d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Creating volume 7f3797a0-9b6a-4b2b-94d6-65d4e325e822 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:22:49 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:49 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 1073741824 Sep 12 07:22:49 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-06a717f7-76c6-4fbb-83f9-4cb4562bf907 tempest-SnapshotsActionsTest-561584102 None] Create snapshot completed successfully Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-0f778a15-7c68-422f-893e-cf6b5f001063-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-0f778a15-7c68-422f-893e-cf6b5f001063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-0f778a15-7c68-422f-893e-cf6b5f001063" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-0f778a15-7c68-422f-893e-cf6b5f001063" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Deleting offline snapshot 0f778a15-7c68-422f-893e-cf6b5f001063 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] snapshot_file for this snap is: volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e55b0-7192-415d-9130-0fb434562dbf]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:50 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 1073741824" returned: 0 in 0.609s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:50 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 Sep 12 07:22:50 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:50 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 Sep 12 07:22:50 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:50 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063" returned: 0 in 0.507s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e581cd-1033-4259-bed8-9433d8f33274]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:50 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" returned: 0 in 0.416s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Attempting download of 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'metadata': {}}])) to volume 7f3797a0-9b6a-4b2b-94d6-65d4e325e822. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:22:50 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:50 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f8251b-7247-43ca-84ae-e4254f9e6141]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:50 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt Sep 12 07:22:50 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:51 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.472s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:51 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 Sep 12 07:22:51 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:51 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt" returned: 0 in 0.406s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:51 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt Sep 12 07:22:51 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:51 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063" returned: 0 in 0.417s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:51 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063 Sep 12 07:22:51 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:51 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt" returned: 1 in 0.407s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1_j8lc01zt' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2537046-6562-4bb1-8601-6e603dfd71f6]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:51 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD Sep 12 07:22:51 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:51 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0f778a15-7c68-422f-893e-cf6b5f001063" returned: 0 in 0.334s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-0f778a15-7c68-422f-893e-cf6b5f001063" released by "_delete_snapshot" :: held 1.864s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" released by "delete_snapshot" :: held 1.893s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Created reservations ['90860f96-8530-40c5-b399-d91be4148a61', '38401ecf-4c04-4522-ac74-0f05749e4a9f', '46271271-7697-4df5-8f8f-b64d7c1e5ba2', '52e61d27-33fe-4a3b-bb7f-716fe8355704'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:51 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Delete snapshot completed successfully. Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d57a3bdf-3f86-4e13-97e4-d31257a5177e tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-0f778a15-7c68-422f-893e-cf6b5f001063-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:52 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD Sep 12 07:22:52 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:52 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD" returned: 1 in 0.702s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 was raw, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:52 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 Sep 12 07:22:52 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Creating offline snapshot 0a265502-91c5-4d59-ab41-ac94943a65e3 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce86d2f2-bab1-4d7e-a385-9cfbdc8b1e39]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:53 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:53 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:53 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.488s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:53 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" returned: 0 in 0.830s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:53 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ee2c1e4-fd28-4e45-a341-f311b6ae1de1__emyo5a4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:22:53 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Converted 0.00 MB image at 0.00 MB/s Sep 12 07:22:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:53 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 1G Sep 12 07:22:53 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:53 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 1G Sep 12 07:22:53 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:54 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 1G" returned: 0 in 0.500s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Downloaded image 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'metadata': {}}])) to volume 7f3797a0-9b6a-4b2b-94d6-65d4e325e822 successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Temporary image 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 for user b8a86426d3d94a7ca4633e20fff1d4cf is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Marking volume 7f3797a0-9b6a-4b2b-94d6-65d4e325e822 as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Copying metadata from image 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 to 7f3797a0-9b6a-4b2b-94d6-65d4e325e822. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Creating volume glance metadata for volume 7f3797a0-9b6a-4b2b-94d6-65d4e325e822 backed by image 9ee2c1e4-fd28-4e45-a341-f311b6ae1de1 with: {'image_id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'df054a14948220694227735656566175', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77bd427f-cbde-4063-bd7b-d26b75f5679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822', 'volume_size': 1, 'image_id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df054a14948220694227735656566175', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7602d119139e47a3a916cf28141a6207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe740d07044f366969f45d5bda932238c1ee66e85d9b08bdeefef3a922aa7052b5faea451937ea1cde25f8b3ed95981bcc7bcfcaf6a1d64d855d8d018b9bbc2b', 'id': '9ee2c1e4-fd28-4e45-a341-f311b6ae1de1', 'created_at': datetime.datetime(2026, 9, 12, 5, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 22, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ee2c1e4-fd28-4e45-a341-f311b6ae1de1/file', 'properties': {}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e80a7f-67d9-47b1-a017-14b1b9e630f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:22:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Volume volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 (7f3797a0-9b6a-4b2b-94d6-65d4e325e822): created successfully Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e80a7f-67d9-47b1-a017-14b1b9e630f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Flow 'volume_create_manager' (6073b55f-5dec-4908-ac91-6a2204b6ab68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:22:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1a38a54b-5e43-4063-a36a-f3f80af5b721 tempest-VolumeImageDependencyTests-661552387 None] Created volume successfully. Sep 12 07:22:54 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 1G" returned: 0 in 0.760s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:54 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 Sep 12 07:22:54 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:54 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3" returned: 0 in 0.339s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:54 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 is being set with open permissions: ugo+rw Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:54 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 Sep 12 07:22:54 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Acquiring lock "cinder-7f3797a0-9b6a-4b2b-94d6-65d4e325e822-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Lock "cinder-7f3797a0-9b6a-4b2b-94d6-65d4e325e822-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Acquiring lock "cinder-quobyte-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Lock "cinder-quobyte-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aad408-8fad-4b21-af20-c94d8059e7d5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:54 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3" returned: 0 in 0.285s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-28ab0cb9-cf43-4b64-94f4-d4d6760e50c7 tempest-SnapshotsActionsTest-561584102 None] Create snapshot completed successfully Sep 12 07:22:54 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 Sep 12 07:22:54 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:55 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" returned: 0 in 0.407s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:55 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822 Sep 12 07:22:55 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:55 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Lock "cinder-quobyte-7f3797a0-9b6a-4b2b-94d6-65d4e325e822" released by "delete_volume" :: held 0.713s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Created reservations ['bd7f867a-5c59-4e47-9c34-056b2c974910', 'cbbf2fd9-e1ff-40c4-97be-292d5a173b6a', '1048251d-8acc-46c6-963e-1d0e4f256b20', '4077fed2-d30e-401b-a3be-d86066e36917'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:22:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:55 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:22:55 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:56 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.283s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:22:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Deleted volume successfully. Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-34671525-061e-4f63-8562-0c30795e1ac4 tempest-VolumeImageDependencyTests-661552387 None] Lock "cinder-7f3797a0-9b6a-4b2b-94d6-65d4e325e822-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-0a265502-91c5-4d59-ab41-ac94943a65e3-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-0a265502-91c5-4d59-ab41-ac94943a65e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Acquiring lock "cinder-quobyte-0a265502-91c5-4d59-ab41-ac94943a65e3" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-0a265502-91c5-4d59-ab41-ac94943a65e3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Deleting offline snapshot 0a265502-91c5-4d59-ab41-ac94943a65e3 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] snapshot_file for this snap is: volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9affda60-5b41-4352-ae14-d90f0412dc63]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:56 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 Sep 12 07:22:56 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:56 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c6e6a-8c73-49ce-8dd3-81b1df669890]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:56 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:56 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:57 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.433s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:57 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 Sep 12 07:22:57 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:57 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3" returned: 0 in 0.433s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:57 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3 Sep 12 07:22:57 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:57 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.0a265502-91c5-4d59-ab41-ac94943a65e3" returned: 0 in 0.304s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-0a265502-91c5-4d59-ab41-ac94943a65e3" released by "_delete_snapshot" :: held 1.743s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" released by "delete_snapshot" :: held 1.782s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Created reservations ['fa34e9cc-a24d-4753-b894-9220dd4bbc56', '61688734-6d12-463b-8bd3-6bdeb39f1e55', '26be4273-7553-405d-aca4-dc2aa2f41831', 'e6c40ade-5e76-4d4b-bae8-132a2091057c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:22:58 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Delete snapshot completed successfully. Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a2946a6b-8fe9-48b3-9ee1-606dfa4981da tempest-SnapshotsActionsTest-522243411 None] Lock "cinder-0a265502-91c5-4d59-ab41-ac94943a65e3-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "cinder-1ec0a784-3b80-45c9-b640-58cfd3a0aed5-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-1ec0a784-3b80-45c9-b640-58cfd3a0aed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "cinder-quobyte-1ec0a784-3b80-45c9-b640-58cfd3a0aed5" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-quobyte-1ec0a784-3b80-45c9-b640-58cfd3a0aed5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Deleting offline snapshot 1ec0a784-3b80-45c9-b640-58cfd3a0aed5 of volume 5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] snapshot_file for this snap is: volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[898400fb-edc1-43d8-8508-fa1849420125]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:59 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:59 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:59 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:22:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d412ce-3d0e-4a46-9be8-93b7464a7bb6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:22:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:59 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 Sep 12 07:22:59 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:22:59 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 12 07:22:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7" returned: 0 in 0.485s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:22:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:22:59 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:22:59 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Flow 'volume_create_manager' (36b96b7a-5003-4af8-8c46-d2aeeff57cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd25d1-be01-40aa-83bd-a0cfdc6df4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd25d1-be01-40aa-83bd-a0cfdc6df4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ceea8f-8652-4921-bf4d-b5ba290e47ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452cc20f681c4e1eaa20bd8564927a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:00Z,use_quota=True,user_id='3629462a57d54a7ca31d77802be7c7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1c6be5-511c-4e61-9aec-a02090bb6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1c6be5-511c-4e61-9aec-a02090bb6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ef5a57-9e26-434b-9803-887d5eab3360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ef5a57-9e26-434b-9803-887d5eab3360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ceea8f-8652-4921-bf4d-b5ba290e47ef', 'volume_name': 'volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd4b4b-64ca-44c0-a23f-f66a58697422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd4b4b-64ca-44c0-a23f-f66a58697422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9683b3a-9781-47a4-9c7f-acc8520169af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Volume e0ceea8f-8652-4921-bf4d-b5ba290e47ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef', 'volume_size': 1} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ceea8f-8652-4921-bf4d-b5ba290e47ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452cc20f681c4e1eaa20bd8564927a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:00Z,use_quota=True,user_id='3629462a57d54a7ca31d77802be7c7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Creating volume e0ceea8f-8652-4921-bf4d-b5ba290e47ef {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:00 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:00 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.366s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:00 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef 1073741824 Sep 12 07:23:00 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:00 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5 Sep 12 07:23:00 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Flow 'volume_create_manager' (56ee2588-31ab-44c2-af49-85d43daa4f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93723582-13e1-4d69-a2d5-605b2de44b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93723582-13e1-4d69-a2d5-605b2de44b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415492760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec580f4-cb5c-4158-98ee-d014ab8d33db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a40f08408a49f09696700f689c18cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:00Z,use_quota=True,user_id='df573566b2cb4c848d270e140f3bc12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3dbd3f-2e15-4c2c-a076-76b24048aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3dbd3f-2e15-4c2c-a076-76b24048aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a44cf5-4388-4a21-8d9e-2cb9adcc85fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a44cf5-4388-4a21-8d9e-2cb9adcc85fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec580f4-cb5c-4158-98ee-d014ab8d33db', 'volume_name': 'volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d330b13-33b2-4a6b-aad7-19b205c351a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d330b13-33b2-4a6b-aad7-19b205c351a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6fa7e9-eb24-4f48-8ccb-53bd3ad15c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:00 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Volume 2ec580f4-cb5c-4158-98ee-d014ab8d33db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db', 'volume_size': 1} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:00 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7.1ec0a784-3b80-45c9-b640-58cfd3a0aed5" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-quobyte-1ec0a784-3b80-45c9-b640-58cfd3a0aed5" released by "_delete_snapshot" :: held 1.634s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" released by "delete_snapshot" :: held 1.671s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Created reservations ['d35a6392-9700-4af0-8fac-f9764c89ca16', '3591f76d-6d00-4e3b-8b24-a502fcc694f4', '70dc2d1c-d9fd-4588-ab01-bf6c6621c881', '74063573-57af-422f-a8a2-3869a69b8398'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:00 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef 1073741824" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Delete snapshot completed successfully. Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-73056373-407c-494e-9700-79ed8c5f135e tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-1ec0a784-3b80-45c9-b640-58cfd3a0aed5-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:00 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef Sep 12 07:23:00 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:00 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef" returned: 0 in 0.275s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415492760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec580f4-cb5c-4158-98ee-d014ab8d33db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a40f08408a49f09696700f689c18cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:00Z,use_quota=True,user_id='df573566b2cb4c848d270e140f3bc12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Creating volume 2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:00 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9683b3a-9781-47a4-9c7f-acc8520169af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:01 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db 1073741824 Sep 12 07:23:01 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5d6cb6-6035-410c-8fd8-edc93759419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Volume volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef (e0ceea8f-8652-4921-bf4d-b5ba290e47ef): created successfully Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5d6cb6-6035-410c-8fd8-edc93759419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Flow 'volume_create_manager' (36b96b7a-5003-4af8-8c46-d2aeeff57cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-10066f0b-60c9-4bfd-83ff-895b6ce7bac0 tempest-CinderUnicodeTest-670089061 None] Created volume successfully. Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "cinder-5c8db51c-0237-4e31-a8fa-de1aebd617f7-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-5c8db51c-0237-4e31-a8fa-de1aebd617f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[01303ae4-8e09-41bc-a3df-7580e1135699]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:01 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 Sep 12 07:23:01 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:01 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db 1073741824" returned: 0 in 0.545s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:01 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:23:01 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:01 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:01 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7 Sep 12 07:23:01 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:01 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6fa7e9-eb24-4f48-8ccb-53bd3ad15c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd3b7c6-07e3-49e4-a491-a9cedb69b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Volume volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db (2ec580f4-cb5c-4158-98ee-d014ab8d33db): created successfully Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd3b7c6-07e3-49e4-a491-a9cedb69b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Flow 'volume_create_manager' (56ee2588-31ab-44c2-af49-85d43daa4f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:01 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4dd51e75-9279-4ea5-bdc2-99bc4f43805d tempest-VolumesActionsTest-1717267581 None] Created volume successfully. Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5c8db51c-0237-4e31-a8fa-de1aebd617f7" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-quobyte-5c8db51c-0237-4e31-a8fa-de1aebd617f7" released by "delete_volume" :: held 0.745s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:01 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Created reservations ['4fc099c8-7c56-4e58-b7b0-8c47f96cefe0', '27ce4400-bf2b-45bd-b762-fd133f28c304', 'cd1505bc-b3c1-4ceb-b2ee-3c3ee9f4b284', '0cfd3230-9c2a-41ea-842c-363b949f0017'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:02 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:02 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:02 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.273s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Deleted volume successfully. Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ebcd153-1006-4dbd-9474-980894e1a067 tempest-SnapshotsActionsTest-561584102 None] Lock "cinder-5c8db51c-0237-4e31-a8fa-de1aebd617f7-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Flow 'volume_create_manager' (ab50e0c6-448c-4c8d-9862-0134127589ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad9621c-83e7-4197-9a4d-9f8858089e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad9621c-83e7-4197-9a4d-9f8858089e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1780697783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0ae02c-5ec1-4524-bf19-312c3f2555fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452cc20f681c4e1eaa20bd8564927a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:03Z,use_quota=True,user_id='3629462a57d54a7ca31d77802be7c7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7720975-3f77-4358-941b-d26c8c240be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7720975-3f77-4358-941b-d26c8c240be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe382422-52ea-4cca-accc-74004811b33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe382422-52ea-4cca-accc-74004811b33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0ae02c-5ec1-4524-bf19-312c3f2555fb', 'volume_name': 'volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daef5b51-9a4a-4a1d-996f-87adefcac081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daef5b51-9a4a-4a1d-996f-87adefcac081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40d6e83-9298-4a86-9cf2-96e368d5286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:03 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Volume 8d0ae02c-5ec1-4524-bf19-312c3f2555fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb', 'volume_size': 1} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1780697783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0ae02c-5ec1-4524-bf19-312c3f2555fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452cc20f681c4e1eaa20bd8564927a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:03Z,use_quota=True,user_id='3629462a57d54a7ca31d77802be7c7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Creating volume 8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:03 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:03 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb 1073741824 Sep 12 07:23:03 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:03 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb 1073741824" returned: 0 in 0.509s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:03 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb Sep 12 07:23:03 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:03 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" returned: 0 in 0.303s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40d6e83-9298-4a86-9cf2-96e368d5286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e8e378-524d-4dcb-8a49-bc127b011193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:03 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Volume volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb (8d0ae02c-5ec1-4524-bf19-312c3f2555fb): created successfully Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e8e378-524d-4dcb-8a49-bc127b011193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Flow 'volume_create_manager' (ab50e0c6-448c-4c8d-9862-0134127589ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:03 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-def44e30-355b-4003-8515-6cd09d163bc4 tempest-CinderUnicodeTest-670089061 None] Created volume successfully. Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Creating offline snapshot 91dd8859-f70d-4863-ba04-c2a106f9f83f of volume 8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fb0772-8dfe-43fb-816d-1461c870d9f9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:05 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb Sep 12 07:23:05 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Flow 'volume_create_manager' (452db0df-7023-4a51-888c-5345efe3349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27f106a-7bfd-4ee3-8da1-bf07d371695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27f106a-7bfd-4ee3-8da1-bf07d371695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1726701871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47deb9db-3ac3-4afd-8d3c-de92965c81e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f7591afd44c3aa12cd79a9b0850b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:06Z,use_quota=True,user_id='8580a7c415744c8a9039159ba0f53915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570cfcb6-5712-416d-bdd4-bea13e4f58c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570cfcb6-5712-416d-bdd4-bea13e4f58c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa6777a-66af-4535-bf6c-64abf9c66d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa6777a-66af-4535-bf6c-64abf9c66d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47deb9db-3ac3-4afd-8d3c-de92965c81e6', 'volume_name': 'volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6821779f-5dcf-43e1-a5d2-d7a7666fc251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6821779f-5dcf-43e1-a5d2-d7a7666fc251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30a5fb8-8a2a-41c5-b044-875495c713b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Volume 47deb9db-3ac3-4afd-8d3c-de92965c81e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6', 'volume_size': 1} Sep 12 07:23:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:06 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" returned: 0 in 0.660s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:06 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f 1G Sep 12 07:23:06 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:06 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f 1G" returned: 0 in 0.495s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:06 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f Sep 12 07:23:06 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:06 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f" returned: 0 in 0.320s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:06 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f is being set with open permissions: ugo+rw Sep 12 07:23:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:06 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f Sep 12 07:23:06 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:07 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f" returned: 0 in 0.336s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:07 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info Sep 12 07:23:07 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:07 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:07 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info is being set with open permissions: ugo+rw Sep 12 07:23:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:07 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info Sep 12 07:23:07 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:08 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.info" returned: 0 in 0.624s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.925s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1726701871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47deb9db-3ac3-4afd-8d3c-de92965c81e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f7591afd44c3aa12cd79a9b0850b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:06Z,use_quota=True,user_id='8580a7c415744c8a9039159ba0f53915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Creating volume 47deb9db-3ac3-4afd-8d3c-de92965c81e6 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:08 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:08 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 1073741824 Sep 12 07:23:08 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-565e66bc-c2b5-453d-9073-f5e8cd59097a tempest-CinderUnicodeTest-670089061 None] Create snapshot completed successfully Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-91dd8859-f70d-4863-ba04-c2a106f9f83f-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-91dd8859-f70d-4863-ba04-c2a106f9f83f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-quobyte-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-quobyte-91dd8859-f70d-4863-ba04-c2a106f9f83f" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-91dd8859-f70d-4863-ba04-c2a106f9f83f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Deleting offline snapshot 91dd8859-f70d-4863-ba04-c2a106f9f83f of volume 8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] snapshot_file for this snap is: volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe1a6b6-d4d2-4fec-aff6-5dc487263795]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:09 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f Sep 12 07:23:09 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:09 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 1073741824" returned: 0 in 0.978s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:09 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 Sep 12 07:23:09 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:09 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f" returned: 0 in 0.821s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c969e2b-2025-43b6-8f00-9a24fbf1148c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:09 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30a5fb8-8a2a-41c5-b044-875495c713b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba215056-08a9-4a73-bc77-67935a9a9fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Volume volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 (47deb9db-3ac3-4afd-8d3c-de92965c81e6): created successfully Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba215056-08a9-4a73-bc77-67935a9a9fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Flow 'volume_create_manager' (452db0df-7023-4a51-888c-5345efe3349c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ca21d95e-bc15-40f9-beb0-c44a8137418b tempest-AttachVolumeNegativeTest-1632986707 None] Created volume successfully. Sep 12 07:23:09 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb Sep 12 07:23:09 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:10 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" returned: 0 in 0.631s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:10 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f Sep 12 07:23:10 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:11 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f" returned: 0 in 0.646s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:11 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f Sep 12 07:23:11 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:11 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb.91dd8859-f70d-4863-ba04-c2a106f9f83f" returned: 0 in 0.320s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-91dd8859-f70d-4863-ba04-c2a106f9f83f" released by "_delete_snapshot" :: held 2.609s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" released by "delete_snapshot" :: held 2.665s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-12a514ee-6b43-48d6-9789-b37c083bf171 req-a4d33e9e-2c2c-4dfb-9102-7b1a068a47df tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-12a514ee-6b43-48d6-9789-b37c083bf171 req-a4d33e9e-2c2c-4dfb-9102-7b1a068a47df tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-12a514ee-6b43-48d6-9789-b37c083bf171 req-a4d33e9e-2c2c-4dfb-9102-7b1a068a47df tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Created reservations ['7e85bf00-1a38-4969-be11-8530e02f774e', 'db1135c5-c37b-4f93-9ea3-334afa1675bd', '98e834ce-c9c2-4cb9-a67e-300a0b0bb0be', 'af80c23f-25e6-437e-81fe-861bf7a6d03a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-12a514ee-6b43-48d6-9789-b37c083bf171 req-a4d33e9e-2c2c-4dfb-9102-7b1a068a47df tempest-AttachVolumeNegativeTest-1632986707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5400af54-a9a8-4084-bb76-481f521645d2', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:23:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Delete snapshot completed successfully. Sep 12 07:23:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-12a514ee-6b43-48d6-9789-b37c083bf171 req-a4d33e9e-2c2c-4dfb-9102-7b1a068a47df tempest-AttachVolumeNegativeTest-1632986707 None] attachment_update completed successfully. Sep 12 07:23:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ba573b9-d3b6-48f8-acf0-61da794bc450 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-91dd8859-f70d-4863-ba04-c2a106f9f83f-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-8d0ae02c-5ec1-4524-bf19-312c3f2555fb-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-8d0ae02c-5ec1-4524-bf19-312c3f2555fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-quobyte-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d37d329-a7cd-4eda-b614-3f1a97f7c995]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-601cfb08-f49a-401f-9a16-a617f2856f1a tempest-VolumesActionsTest-1717267581 None] Acquiring lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db" by "attach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-601cfb08-f49a-401f-9a16-a617f2856f1a tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db" acquired by "attach_volume" :: waited 0.043s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:12 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb Sep 12 07:23:12 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-601cfb08-f49a-401f-9a16-a617f2856f1a tempest-VolumesActionsTest-1717267581 None] Attaching volume 2ec580f4-cb5c-4158-98ee-d014ab8d33db to instance 240a215d-e00a-4409-bc8b-d0285676a997 at mountpoint /dev/vdb on host None. Sep 12 07:23:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-601cfb08-f49a-401f-9a16-a617f2856f1a tempest-VolumesActionsTest-1717267581 None] Attach volume completed successfully. Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-601cfb08-f49a-401f-9a16-a617f2856f1a tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db" released by "attach_volume" :: held 0.201s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aaebe3e8-455b-4fac-8fc6-3e43ac0258a6 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-detach_volume" by "detach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aaebe3e8-455b-4fac-8fc6-3e43ac0258a6 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-aaebe3e8-455b-4fac-8fc6-3e43ac0258a6 tempest-VolumesActionsTest-1717267581 None] Detaching volume 2ec580f4-cb5c-4158-98ee-d014ab8d33db from instance 240a215d-e00a-4409-bc8b-d0285676a997. Sep 12 07:23:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-aaebe3e8-455b-4fac-8fc6-3e43ac0258a6 tempest-VolumesActionsTest-1717267581 None] Detach volume completed successfully. Sep 12 07:23:12 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" returned: 0 in 0.662s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aaebe3e8-455b-4fac-8fc6-3e43ac0258a6 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:13 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb Sep 12 07:23:13 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:13 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" returned: 0 in 0.468s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-8d0ae02c-5ec1-4524-bf19-312c3f2555fb" released by "delete_volume" :: held 1.311s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Created reservations ['3f06ed30-783a-4edc-8d8d-e73218996ff9', '95909bd3-6a9b-49f3-9d27-b7298a3626f4', '6aa43e21-6ebb-4fde-aa40-0c344f489cec', '20bdadce-42f2-43bd-9615-558436693304'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:13 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:13 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:14 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Deleted volume successfully. Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-63d81883-9de4-4ce5-b47f-f81435ba5dc0 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-8d0ae02c-5ec1-4524-bf19-312c3f2555fb-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-e0ceea8f-8652-4921-bf4d-b5ba290e47ef-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-e0ceea8f-8652-4921-bf4d-b5ba290e47ef-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "cinder-quobyte-e0ceea8f-8652-4921-bf4d-b5ba290e47ef" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-e0ceea8f-8652-4921-bf4d-b5ba290e47ef" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[305267d9-392a-44b5-a816-4ae1b8e1799f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:14 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef Sep 12 07:23:14 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-13375bce-d588-411c-bba8-3a8492b71ebc req-dc5b9b41-2d3e-410b-aa7c-7b5466da333c tempest-AttachVolumeNegativeTest-1632986707 None] Terminate volume connection completed successfully. Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-13375bce-d588-411c-bba8-3a8492b71ebc req-dc5b9b41-2d3e-410b-aa7c-7b5466da333c tempest-AttachVolumeNegativeTest-1632986707 None] Deleting attachment 5400af54-a9a8-4084-bb76-481f521645d2. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:23:15 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef" returned: 0 in 0.605s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:15 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef Sep 12 07:23:15 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:15 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e0ceea8f-8652-4921-bf4d-b5ba290e47ef" returned: 0 in 0.374s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-quobyte-e0ceea8f-8652-4921-bf4d-b5ba290e47ef" released by "delete_volume" :: held 1.072s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Created reservations ['49071028-99e7-4afb-a571-c193199eaadf', 'a1ca4908-8b7c-40c5-ab2a-84805500a072', '7de55f14-8f60-41e6-8f9f-763a0c7866fa', '06aeefbf-4217-44f5-84e4-a03cae3ccafd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:16 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:16 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:16 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.456s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:16 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Deleted volume successfully. Sep 12 07:23:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0f06a465-1cfa-488b-9636-330ac1468c81 tempest-CinderUnicodeTest-670089061 None] Lock "cinder-e0ceea8f-8652-4921-bf4d-b5ba290e47ef-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "cinder-47deb9db-3ac3-4afd-8d3c-de92965c81e6-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-47deb9db-3ac3-4afd-8d3c-de92965c81e6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:20 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=138,cinder:INSERT=43,cinder:UPDATE=124,cinder:DELETE=14 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:23:20 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=129,cinder:UPDATE=144,cinder:INSERT=35,cinder:DELETE=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:23:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "cinder-quobyte-47deb9db-3ac3-4afd-8d3c-de92965c81e6" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-quobyte-47deb9db-3ac3-4afd-8d3c-de92965c81e6" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a4b89-601f-4994-bc3f-ba5e805f3707]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:21 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 Sep 12 07:23:21 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:21 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Flow 'volume_create_manager' (de199b5b-79d2-41b5-8d12-1d413645b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4d26a1-8da8-4067-b0e3-d15aa0830ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6" returned: 0 in 0.826s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4d26a1-8da8-4067-b0e3-d15aa0830ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1607004600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2121f6-f6c5-4297-a70c-e198bad30521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9017d0cfb5e84f3eaa8ddfccb7affe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:22Z,use_quota=True,user_id='5fe51c9c49394a3c8e442cbf5161d680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(533c58f2-5a55-4026-928f-80283708ed1f),volume_type_id=533c58f2-5a55-4026-928f-80283708ed1f)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81272f4c-0914-4e0c-9109-693c49ab5bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81272f4c-0914-4e0c-9109-693c49ab5bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7d447f-d483-497a-8b98-690467ef9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:21 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6 Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7d447f-d483-497a-8b98-690467ef9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2121f6-f6c5-4297-a70c-e198bad30521', 'volume_name': 'volume-8b2121f6-f6c5-4297-a70c-e198bad30521', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:21 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f01fb3-999d-40eb-ae08-328f427c159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f01fb3-999d-40eb-ae08-328f427c159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1364fe9c-1a89-46b1-ae0c-02e54fe612cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Volume 8b2121f6-f6c5-4297-a70c-e198bad30521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2121f6-f6c5-4297-a70c-e198bad30521', 'volume_size': 1} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1607004600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2121f6-f6c5-4297-a70c-e198bad30521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9017d0cfb5e84f3eaa8ddfccb7affe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:22Z,use_quota=True,user_id='5fe51c9c49394a3c8e442cbf5161d680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(533c58f2-5a55-4026-928f-80283708ed1f),volume_type_id=533c58f2-5a55-4026-928f-80283708ed1f)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Creating volume 8b2121f6-f6c5-4297-a70c-e198bad30521 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:21 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:21 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 1073741824 Sep 12 07:23:21 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:22 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-47deb9db-3ac3-4afd-8d3c-de92965c81e6" returned: 0 in 0.350s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-quobyte-47deb9db-3ac3-4afd-8d3c-de92965c81e6" released by "delete_volume" :: held 1.240s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Created reservations ['86c6a9aa-346d-48e8-aea8-23c21e9b65b0', 'edd3573c-2928-4327-b52b-9b5acc25a18f', '55a20579-8ada-4e6c-aa1e-26d593faa532', '0d97546b-fd13-42d0-8c5e-1099dbca9137'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:22 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:22 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:22 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Flow 'volume_create_manager' (9f53e4ea-45fd-4fb5-b14b-c46ce9afea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4d8e4e-5f36-4e2e-836b-1a103c953011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 1073741824" returned: 0 in 0.628s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4d8e4e-5f36-4e2e-836b-1a103c953011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555332444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c7e2a9277745538514919b9ca4f84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:22Z,use_quota=True,user_id='6044e22b82484dfc9cf409aa746ab74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07caa31-0550-4140-a97f-287f504c56c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07caa31-0550-4140-a97f-287f504c56c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30163b30-d01c-4399-998b-526b104870b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30163b30-d01c-4399-998b-526b104870b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c', 'volume_name': 'volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d28067-8c74-4bc2-8590-ead698fd4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d28067-8c74-4bc2-8590-ead698fd4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b133531-fc0d-4dad-b0f2-1cc36cd08ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Volume bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c', 'volume_size': 1} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:22 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:22 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 Sep 12 07:23:22 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.321s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Deleted volume successfully. Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-90ca7252-0feb-4ca0-ac04-5bb760e2ec47 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-47deb9db-3ac3-4afd-8d3c-de92965c81e6-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:22 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521" returned: 0 in 0.311s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555332444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c7e2a9277745538514919b9ca4f84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:22Z,use_quota=True,user_id='6044e22b82484dfc9cf409aa746ab74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Creating volume bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:22 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1364fe9c-1a89-46b1-ae0c-02e54fe612cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2121f6-f6c5-4297-a70c-e198bad30521', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:23 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c 1073741824 Sep 12 07:23:23 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35326919-2365-4215-bbc8-4a3e4c0aadad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Volume volume-8b2121f6-f6c5-4297-a70c-e198bad30521 (8b2121f6-f6c5-4297-a70c-e198bad30521): created successfully Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35326919-2365-4215-bbc8-4a3e4c0aadad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Flow 'volume_create_manager' (de199b5b-79d2-41b5-8d12-1d413645b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b45dea1d-4faa-4d18-bfe2-53f687cd2409 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Created volume successfully. Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "cinder-0500d66a-6aca-4f9a-b83f-16fb804b0969-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-0500d66a-6aca-4f9a-b83f-16fb804b0969-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "cinder-quobyte-0500d66a-6aca-4f9a-b83f-16fb804b0969" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-quobyte-0500d66a-6aca-4f9a-b83f-16fb804b0969" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aadc86-23e0-414a-b88e-4770239d149f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:23 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c 1073741824" returned: 0 in 0.536s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:23 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 Sep 12 07:23:23 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:23 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c Sep 12 07:23:23 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:23 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c" returned: 0 in 0.304s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:23 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b133531-fc0d-4dad-b0f2-1cc36cd08ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d770b9-83f3-425b-b2dc-23a676cddbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Volume volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c (bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c): created successfully Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d770b9-83f3-425b-b2dc-23a676cddbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:23 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969 Sep 12 07:23:23 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Flow 'volume_create_manager' (9f53e4ea-45fd-4fb5-b14b-c46ce9afea6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-838ba59e-c72a-4693-8079-4374d8783e5d tempest-ProjectReaderTests-1577191239 None] Created volume successfully. Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:24 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:24 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:24 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0500d66a-6aca-4f9a-b83f-16fb804b0969" returned: 0 in 0.508s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-quobyte-0500d66a-6aca-4f9a-b83f-16fb804b0969" released by "delete_volume" :: held 1.024s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Created reservations ['819df181-696a-4f6a-820d-e1eca736c244', '98fbd910-d748-4db1-9b21-76ac74e88327', '9bc921c7-c469-46fe-b47f-02a4396433f0', 'ef5e5905-3f7f-46a6-97e6-555377156a46'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:24 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.428s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-82bfbbf9-bba9-4e1d-9c8b-216d0c00def6 tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Retype volume completed successfully. Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:24 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:24 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Acquiring lock "cinder-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Lock "cinder-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:25 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.497s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Deleted volume successfully. Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Acquiring lock "cinder-quobyte-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Lock "cinder-quobyte-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c" acquired by "delete_volume" :: waited 0.051s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5416de10-d17f-42d9-8075-89b87d115196 tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-0500d66a-6aca-4f9a-b83f-16fb804b0969-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb21d17-6f96-4a59-b3e5-3ef00f2cf0b8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:25 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c Sep 12 07:23:25 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Acquiring lock "cinder-8b2121f6-f6c5-4297-a70c-e198bad30521-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "cinder-8b2121f6-f6c5-4297-a70c-e198bad30521-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Acquiring lock "cinder-quobyte-8b2121f6-f6c5-4297-a70c-e198bad30521" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "cinder-quobyte-8b2121f6-f6c5-4297-a70c-e198bad30521" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:26 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c" returned: 0 in 0.602s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e51b37f-42bb-49d4-8ecc-8454aa5aef63]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "cinder-2d899d33-80a2-4ff4-9fed-a7fdd67314b4-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:26 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c Sep 12 07:23:26 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-2d899d33-80a2-4ff4-9fed-a7fdd67314b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "cinder-quobyte-2d899d33-80a2-4ff4-9fed-a7fdd67314b4" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-quobyte-2d899d33-80a2-4ff4-9fed-a7fdd67314b4" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4544cd59-f1bb-45d8-aef6-d4381b1b4ae8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:26 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 Sep 12 07:23:26 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:26 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c" returned: 0 in 0.474s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Lock "cinder-quobyte-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c" released by "delete_volume" :: held 1.189s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:26 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 Sep 12 07:23:26 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Created reservations ['5774cf9e-a60a-409e-a25d-4082b051eecd', 'b61bd451-f010-425c-a9b6-6c328db88f24', '471bc827-713a-4f91-8b9f-e55c2db1ec10', '605eb267-6b2d-43c6-b1cb-f49fd3e83b1d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:26 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521" returned: 0 in 0.725s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:26 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:26 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:26 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521 Sep 12 07:23:26 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:26 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4" returned: 0 in 0.713s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:27 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4 Sep 12 07:23:27 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:27 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.406s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Deleted volume successfully. Sep 12 07:23:27 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8b2121f6-f6c5-4297-a70c-e198bad30521" returned: 0 in 0.445s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-26968cd4-a554-4db1-8dd8-f8370bac4035 tempest-ProjectReaderTests-1577191239 None] Lock "cinder-bf8f60b6-85b3-48ff-86de-3fb5c17cbd2c-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "cinder-quobyte-8b2121f6-f6c5-4297-a70c-e198bad30521" released by "delete_volume" :: held 1.266s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:27 devstack cinder-volume[88013]: WARNING cinder.quota [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:23:27 devstack cinder-volume[88013]: WARNING cinder.quota [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Created reservations ['56297d67-97ce-48bb-8fc6-c22e53125ae8', '64c26042-361a-454d-80a0-bcd79851803f', 'a7166c02-b85f-4887-9111-affbfa51af1f', '47d9f74f-0ad9-4f58-ab92-5954b91752d1'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1a5776d3-b959-4196-a9ce-5541b3fd03c6 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db" by "attach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:27 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2d899d33-80a2-4ff4-9fed-a7fdd67314b4" returned: 0 in 0.442s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-quobyte-2d899d33-80a2-4ff4-9fed-a7fdd67314b4" released by "delete_volume" :: held 1.247s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1a5776d3-b959-4196-a9ce-5541b3fd03c6 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db" acquired by "attach_volume" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:27 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:27 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Created reservations ['22e6fa84-1bc7-4cf5-acd2-e88a63b525df', '62699ee8-ef84-4179-b3b9-32faaa088668', '8f6b641d-16a8-4700-b594-ed343d5d4702', 'ac9582e5-d9ff-4c19-96e3-926931380f8a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1a5776d3-b959-4196-a9ce-5541b3fd03c6 tempest-VolumesActionsTest-1717267581 None] Attaching volume 2ec580f4-cb5c-4158-98ee-d014ab8d33db to instance 21d92981-a277-427d-8d41-ad3312b56824 at mountpoint /dev/vdb on host None. Sep 12 07:23:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1a5776d3-b959-4196-a9ce-5541b3fd03c6 tempest-VolumesActionsTest-1717267581 None] Attach volume completed successfully. Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1a5776d3-b959-4196-a9ce-5541b3fd03c6 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db" released by "attach_volume" :: held 0.278s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:27 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:27 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:28 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.634s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Deleted volume successfully. Sep 12 07:23:28 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.493s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f955e02e-f715-4ef1-b09b-4b270e1533bd tempest-VolumeRetypeWithoutMigrationTest-1791497379 None] Lock "cinder-8b2121f6-f6c5-4297-a70c-e198bad30521-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Deleted volume successfully. Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e26ce62b-b4b5-41e2-903b-02b233756116 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-detach_volume" by "detach_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e26ce62b-b4b5-41e2-903b-02b233756116 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e26ce62b-b4b5-41e2-903b-02b233756116 tempest-VolumesActionsTest-1717267581 None] Detaching volume 2ec580f4-cb5c-4158-98ee-d014ab8d33db from instance 21d92981-a277-427d-8d41-ad3312b56824. Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8d492386-246b-4479-84fd-9f9aad906e5a tempest-AttachVolumeNegativeTest-1632986707 None] Lock "cinder-2d899d33-80a2-4ff4-9fed-a7fdd67314b4-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e26ce62b-b4b5-41e2-903b-02b233756116 tempest-VolumesActionsTest-1717267581 None] Detach volume completed successfully. Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Flow 'volume_create_manager' (90e66a5d-1d97-4fa6-b230-52792b1fd368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb58daf-525e-4420-baa5-aa1065b65823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e26ce62b-b4b5-41e2-903b-02b233756116 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-detach_volume" released by "detach_volume" :: held 0.199s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb58daf-525e-4420-baa5-aa1065b65823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494575641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e885d0-7a8a-4716-bb82-e8dd95c5e855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c7e2a9277745538514919b9ca4f84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:28Z,use_quota=True,user_id='6044e22b82484dfc9cf409aa746ab74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9929021-67c2-43d2-9b62-0bb7194c0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9929021-67c2-43d2-9b62-0bb7194c0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a188ee-ca40-4c58-a91a-6cc64412926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a188ee-ca40-4c58-a91a-6cc64412926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e885d0-7a8a-4716-bb82-e8dd95c5e855', 'volume_name': 'volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe1e0e0-40aa-43d8-b1fa-ea0344641228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe1e0e0-40aa-43d8-b1fa-ea0344641228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d26b04a-0d1e-42eb-a60d-d72341d772a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:28 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Volume 55e885d0-7a8a-4716-bb82-e8dd95c5e855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855', 'volume_size': 1} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494575641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e885d0-7a8a-4716-bb82-e8dd95c5e855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c7e2a9277745538514919b9ca4f84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:28Z,use_quota=True,user_id='6044e22b82484dfc9cf409aa746ab74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Creating volume 55e885d0-7a8a-4716-bb82-e8dd95c5e855 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:23:28 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:23:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:28 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 1073741824 Sep 12 07:23:28 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:29 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 1073741824" returned: 0 in 0.935s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:29 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 Sep 12 07:23:29 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:30 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855" returned: 0 in 0.398s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d26b04a-0d1e-42eb-a60d-d72341d772a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cab46d9-759a-4338-b786-73bf13610f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:30 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Volume volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 (55e885d0-7a8a-4716-bb82-e8dd95c5e855): created successfully Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cab46d9-759a-4338-b786-73bf13610f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Flow 'volume_create_manager' (90e66a5d-1d97-4fa6-b230-52792b1fd368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ba62b38b-70a0-4978-b32e-3fcb2e4fc94c tempest-ProjectReaderTests-1577191239 None] Created volume successfully. Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Acquiring lock "cinder-55e885d0-7a8a-4716-bb82-e8dd95c5e855-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:30 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:30 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Lock "cinder-55e885d0-7a8a-4716-bb82-e8dd95c5e855-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Acquiring lock "cinder-quobyte-55e885d0-7a8a-4716-bb82-e8dd95c5e855" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Lock "cinder-quobyte-55e885d0-7a8a-4716-bb82-e8dd95c5e855" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[70efe21a-3990-4972-9b54-d8cade823788]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:30 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 Sep 12 07:23:30 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:30 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:23:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:23:31 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855" returned: 0 in 0.477s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:31 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855 Sep 12 07:23:31 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:31 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-55e885d0-7a8a-4716-bb82-e8dd95c5e855" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Lock "cinder-quobyte-55e885d0-7a8a-4716-bb82-e8dd95c5e855" released by "delete_volume" :: held 0.881s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Created reservations ['fe2125cc-9679-42ea-b9f2-cb324031b12c', '426a6bbd-7194-46f2-8301-76865c277420', 'ab9ab9c1-ac0d-40c4-bffd-f02011e2d826', '33d65fbd-5806-4a50-b529-b9611a42a5a2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:31 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:23:31 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:31 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:23:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Deleted volume successfully. Sep 12 07:23:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dd00654f-7eaf-414d-aec9-b421e876182e tempest-ProjectReaderTests-1577191239 None] Lock "cinder-55e885d0-7a8a-4716-bb82-e8dd95c5e855-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:23:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:23:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae6f605-c77e-4806-b3e7-c0bafe26c420]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:35 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:23:35 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:35 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.414s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d34fc-ab56-4af6-900e-d005ed166431]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:35 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:23:35 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:35 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.441s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.47af8f6f-d584-4451-861e-3563e1beb2194d06s594.img {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:35 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.47af8f6f-d584-4451-861e-3563e1beb2194d06s594.img Sep 12 07:23:35 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:41 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.47af8f6f-d584-4451-861e-3563e1beb2194d06s594.img" returned: 0 in 5.644s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:41 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d3c8d9-0dd7-4aec-87e9-6f7d6a645334]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:23:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:23:41 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:23:41 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:23:41 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=64,cinder:SELECT=42,cinder:INSERT=18,cinder:DELETE=4 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:23:42 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 12 07:23:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.648s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:23:42 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.47af8f6f-d584-4451-861e-3563e1beb2194d06s594.img {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:23:42 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Converted 1024.00 MB image at 181.40 MB/s Sep 12 07:23:42 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] 47af8f6f-d584-4451-861e-3563e1beb219 was raw, no need to convert to raw {{(pid=88013) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 12 07:23:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1fb9fb71-6bac-433b-a93d-a9afe37318ff tempest-GroupsTest-587551071 None] Group tempest-Group1-1653811847: creating Sep 12 07:23:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1fb9fb71-6bac-433b-a93d-a9afe37318ff tempest-GroupsTest-587551071 None] Group tempest-Group1-1653811847: created successfully Sep 12 07:23:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1fb9fb71-6bac-433b-a93d-a9afe37318ff tempest-GroupsTest-587551071 None] Create group completed successfully. Sep 12 07:23:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-35fed2c2-89ac-4886-9807-83be93c50b1e tempest-GroupsTest-587551071 None] Group tempest-Group2-1248152271: creating Sep 12 07:23:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-35fed2c2-89ac-4886-9807-83be93c50b1e tempest-GroupsTest-587551071 None] Group tempest-Group2-1248152271: created successfully Sep 12 07:23:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-35fed2c2-89ac-4886-9807-83be93c50b1e tempest-GroupsTest-587551071 None] Create group completed successfully. Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Flow 'volume_create_manager' (8d68d6d6-666c-4724-b84a-f98ffe353e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfbc70b-356d-4d12-add1-4cb2e8b3f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfbc70b-356d-4d12-add1-4cb2e8b3f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2111193821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9aba05c-cc9a-4e0c-a39f-7ceeb57bbc80,host='devstack@QuobyteHD#QuobyteHD',id=7729bae0-aaf1-4c40-b9a3-f48140c7f003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c82bbbcd214912a0cd7a92059e1f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:52Z,use_quota=True,user_id='93ab769adecf48c8bc6bcc7a0ef041ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68951830-b117-46cb-8f86-18e295c27d9a),volume_type_id=68951830-b117-46cb-8f86-18e295c27d9a)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46667d3e-4c54-4a5a-8769-9a3c1046070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46667d3e-4c54-4a5a-8769-9a3c1046070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7af83f-a015-4f8b-958f-6c1d655b7c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7af83f-a015-4f8b-958f-6c1d655b7c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7729bae0-aaf1-4c40-b9a3-f48140c7f003', 'volume_name': 'volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1a522f-2c5e-4019-aa27-c4020c57210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1a522f-2c5e-4019-aa27-c4020c57210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f95da2-d8d6-42a7-b5a5-747e91e46bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:51 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Volume 7729bae0-aaf1-4c40-b9a3-f48140c7f003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003', 'volume_size': 1} Sep 12 07:23:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Flow 'volume_create_manager' (9cf689ce-c2c2-4d0a-80bf-d2fcb578589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3853ba71-f787-42ee-aac9-ac2214c5fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3853ba71-f787-42ee-aac9-ac2214c5fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1594073063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac76373-b7d2-4689-a352-beda3693732a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93ef6401bcb4a2fac65f30b0c4d9144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:57Z,use_quota=True,user_id='e4a661cae0c640b5b5ac9b6f7d09a72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a40dfd-f2b6-413c-81b4-300592d36fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a40dfd-f2b6-413c-81b4-300592d36fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b699eae-f6e8-4d84-bd3c-f8982c8c4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b699eae-f6e8-4d84-bd3c-f8982c8c4c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac76373-b7d2-4689-a352-beda3693732a', 'volume_name': 'volume-7ac76373-b7d2-4689-a352-beda3693732a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342088e1-e41d-467e-a653-5a5d83fbc87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342088e1-e41d-467e-a653-5a5d83fbc87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b591a344-ac6b-47e9-b429-a4e90dc9efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:23:57 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Volume 7ac76373-b7d2-4689-a352-beda3693732a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac76373-b7d2-4689-a352-beda3693732a', 'volume_size': 1} Sep 12 07:23:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.238s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Uploaded volume to glance image-id: 47af8f6f-d584-4451-861e-3563e1beb219. {{(pid=88013) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.278s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9aba05c-cc9a-4e0c-a39f-7ceeb57bbc80,created_at=2026-09-12T05:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2111193821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9aba05c-cc9a-4e0c-a39f-7ceeb57bbc80,host='devstack@QuobyteHD#QuobyteHD',id=7729bae0-aaf1-4c40-b9a3-f48140c7f003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c82bbbcd214912a0cd7a92059e1f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:52Z,use_quota=True,user_id='93ab769adecf48c8bc6bcc7a0ef041ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68951830-b117-46cb-8f86-18e295c27d9a),volume_type_id=68951830-b117-46cb-8f86-18e295c27d9a)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Creating volume 7729bae0-aaf1-4c40-b9a3-f48140c7f003 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:04 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:04 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 1073741824 Sep 12 07:24:04 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-332a57d8-9159-4abd-b615-7a15eba65da6 tempest-VolumesActionsTest-1717267581 None] Copy volume to image completed successfully. Sep 12 07:24:04 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 1073741824" returned: 0 in 0.497s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:04 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 Sep 12 07:24:04 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:04 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.764s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1594073063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac76373-b7d2-4689-a352-beda3693732a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93ef6401bcb4a2fac65f30b0c4d9144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:23:57Z,use_quota=True,user_id='e4a661cae0c640b5b5ac9b6f7d09a72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Creating volume 7ac76373-b7d2-4689-a352-beda3693732a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:04 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f95da2-d8d6-42a7-b5a5-747e91e46bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:05 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a 1073741824 Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d29a80e-8f16-4db0-bcc5-d182b367e0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:05 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Volume volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 (7729bae0-aaf1-4c40-b9a3-f48140c7f003): created successfully Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d29a80e-8f16-4db0-bcc5-d182b367e0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Flow 'volume_create_manager' (8d68d6d6-666c-4724-b84a-f98ffe353e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-210adb9a-4d5d-4b40-9f1c-6040f979ae86 tempest-GroupsTest-587551071 None] Created volume successfully. Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:05 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a 1073741824" returned: 0 in 0.426s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:05 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a Sep 12 07:24:05 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:05 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.557s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b591a344-ac6b-47e9-b429-a4e90dc9efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac76373-b7d2-4689-a352-beda3693732a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52193898-e6e9-4d76-86c4-ce7dc03fcc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2277d-15b8-45b9-b6dd-562960caf378]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Volume volume-7ac76373-b7d2-4689-a352-beda3693732a (7ac76373-b7d2-4689-a352-beda3693732a): created successfully Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52193898-e6e9-4d76-86c4-ce7dc03fcc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Flow 'volume_create_manager' (9cf689ce-c2c2-4d0a-80bf-d2fcb578589e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-754caa3c-e587-473c-8ff1-80cbbc272aed tempest-AbsoluteLimitsTests-66413594 None] Created volume successfully. Sep 12 07:24:05 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:24:05 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:06 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.368s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a2f570-2a07-4cb7-a038-1b5df40bbf9c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:06 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:24:06 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Acquiring lock "cinder-quobyte-7729bae0-aaf1-4c40-b9a3-f48140c7f003" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Lock "cinder-quobyte-7729bae0-aaf1-4c40-b9a3-f48140c7f003" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e96edc5-c5a5-4c03-82ac-1efda3392ceb]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:06 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.401s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:06 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 Sep 12 07:24:06 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:06 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img Sep 12 07:24:06 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:06 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003" returned: 0 in 0.401s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:06 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003 Sep 12 07:24:06 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Acquiring lock "cinder-7ac76373-b7d2-4689-a352-beda3693732a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Lock "cinder-7ac76373-b7d2-4689-a352-beda3693732a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Acquiring lock "cinder-quobyte-7ac76373-b7d2-4689-a352-beda3693732a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Lock "cinder-quobyte-7ac76373-b7d2-4689-a352-beda3693732a" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[07284f18-3de7-4aa8-90fe-9a2504801788]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:07 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a Sep 12 07:24:07 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:07 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7729bae0-aaf1-4c40-b9a3-f48140c7f003" returned: 0 in 0.628s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Lock "cinder-quobyte-7729bae0-aaf1-4c40-b9a3-f48140c7f003" released by "delete_volume" :: held 1.098s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Created reservations ['200f1991-896c-49a2-9385-1c4dbb7c5fa8'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:07 devstack cinder-volume[88013]: WARNING cinder.quota [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1109223533 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1109223533, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:24:07 devstack cinder-volume[88013]: WARNING cinder.quota [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1109223533 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1109223533, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Created reservations ['a281c1da-03c4-4624-a698-b03c455a3f6d', '5300b96a-a4b8-4cbb-b536-d87051eea664', 'a4bf394a-9c5e-43a5-b12c-f632a31c72b6', '257faa2a-9e2f-422b-af27-624ec22ab94a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:07 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a" returned: 0 in 0.726s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:07 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a Sep 12 07:24:07 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:08 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:08 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:08 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7ac76373-b7d2-4689-a352-beda3693732a" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Lock "cinder-quobyte-7ac76373-b7d2-4689-a352-beda3693732a" released by "delete_volume" :: held 1.200s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Created reservations ['f55840cc-82f4-4f5c-950e-94e10b88b353', '305b9ca8-fe4b-4714-ba3b-634e852c5e0b', '1a9f61b0-8b9d-469f-b553-ffd88030c39d', '6cbf2e54-aa1b-4567-af81-9c154f09b245'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:08 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:08 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:08 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.358s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:08 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Deleted volume successfully. Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-127130e9-3175-48f6-a125-c4aa81affd30 tempest-AbsoluteLimitsTests-66413594 None] Lock "cinder-7ac76373-b7d2-4689-a352-beda3693732a-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:09 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 1.002s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a298d21a-3c57-4b46-9e1e-3fa09ba35ee5 tempest-GroupsTest-587551071 None] Delete group completed successfully. Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Created reservations ['2e2f250f-a156-46d9-80a6-ec42b13e1568'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:09 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:09 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:10 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.528s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:10 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-eca2aa0f-0afd-4504-840c-3586cc94f55a tempest-GroupsTest-587551071 None] Delete group completed successfully. Sep 12 07:24:12 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img" returned: 0 in 5.523s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e246206-64fe-4107-8edb-8c01fde09d42]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0ffcc1b4-9b53-48cc-998a-21365bd9dce5 tempest-GroupsTest-587551071 None] Group tempest-GroupsTest-Group-630601009: creating Sep 12 07:24:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0ffcc1b4-9b53-48cc-998a-21365bd9dce5 tempest-GroupsTest-587551071 None] Group tempest-GroupsTest-Group-630601009: created successfully Sep 12 07:24:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0ffcc1b4-9b53-48cc-998a-21365bd9dce5 tempest-GroupsTest-587551071 None] Create group completed successfully. Sep 12 07:24:12 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:24:12 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:12 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.561s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:24:12 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Converted 1024.00 MB image at 185.39 MB/s Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] 886797ec-efdb-409b-9a9e-34274c43da2f was raw, converting to qcow2 {{(pid=88013) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce168423-0e7f-4391-9217-930675bf383b]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:12 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img Sep 12 07:24:12 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:12 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img" returned: 0 in 0.338s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:13 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img Sep 12 07:24:13 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:13 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img" returned: 1 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img /opt/stack/data/cinder/conversion/vol_upload_gs555wfr {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:13 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img /opt/stack/data/cinder/conversion/vol_upload_gs555wfr Sep 12 07:24:13 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:13 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img /opt/stack/data/cinder/conversion/vol_upload_gs555wfr" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Image conversion details: src /opt/stack/data/cinder/conversion/2ec580f4-cb5c-4158-98ee-d014ab8d33db.temp_image.886797ec-efdb-409b-9a9e-34274c43da2ff4m2n4z2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gs555wfr {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:24:13 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec641118-3ba7-4208-8c24-04bb4aaced8b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gs555wfr {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Flow 'volume_create_manager' (9fcd669e-6470-41fe-8d81-953a3dc8ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:13 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gs555wfr Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d535d4-5242-46f9-a9d6-464291ad2c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:13 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d535d4-5242-46f9-a9d6-464291ad2c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328970649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6876d06e-7494-4947-88b9-fec4427169fd,host='devstack@QuobyteHD#QuobyteHD',id=7bfa531f-d942-47ae-8e9b-6dfd2e19190d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c82bbbcd214912a0cd7a92059e1f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:14Z,use_quota=True,user_id='93ab769adecf48c8bc6bcc7a0ef041ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10be4c29-cfde-4c87-a356-da20d19cf7cb),volume_type_id=10be4c29-cfde-4c87-a356-da20d19cf7cb)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c7b2b3-4e13-4853-abd8-04dd8422efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c7b2b3-4e13-4853-abd8-04dd8422efab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688367fe-29d4-47be-a528-68b390e2424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688367fe-29d4-47be-a528-68b390e2424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfa531f-d942-47ae-8e9b-6dfd2e19190d', 'volume_name': 'volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a675aae0-eded-4ab9-a910-f2910163868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a675aae0-eded-4ab9-a910-f2910163868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebdc1a7-89e9-4df3-89cd-0eb8feec95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:13 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Volume 7bfa531f-d942-47ae-8e9b-6dfd2e19190d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d', 'volume_size': 1} Sep 12 07:24:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:14 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gs555wfr" returned: 0 in 0.353s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.661s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Uploaded volume to glance image-id: 886797ec-efdb-409b-9a9e-34274c43da2f. {{(pid=88013) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6876d06e-7494-4947-88b9-fec4427169fd,created_at=2026-09-12T05:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328970649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6876d06e-7494-4947-88b9-fec4427169fd,host='devstack@QuobyteHD#QuobyteHD',id=7bfa531f-d942-47ae-8e9b-6dfd2e19190d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c82bbbcd214912a0cd7a92059e1f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:14Z,use_quota=True,user_id='93ab769adecf48c8bc6bcc7a0ef041ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10be4c29-cfde-4c87-a356-da20d19cf7cb),volume_type_id=10be4c29-cfde-4c87-a356-da20d19cf7cb)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Creating volume 7bfa531f-d942-47ae-8e9b-6dfd2e19190d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:15 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:15 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d 1073741824 Sep 12 07:24:15 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d17fac30-4ec2-4c67-b64e-1d838d102008 tempest-VolumesActionsTest-1717267581 None] Copy volume to image completed successfully. Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Flow 'volume_create_manager' (b1f11a3d-3a7d-4679-a4c4-0c5c5497ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924e517d-f6e3-40f4-9e2f-a3dbbe27eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:15 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924e517d-f6e3-40f4-9e2f-a3dbbe27eaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1598323020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7ef61e-d964-41f6-b950-6af3001b106b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a678690c093343f781e8fc867047a765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:16Z,use_quota=True,user_id='3fa55ac46020476599efe93b5bddaef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fc3181-4397-4eb8-b4a9-d2c41358f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fc3181-4397-4eb8-b4a9-d2c41358f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbcbfa3-039e-4b68-abc8-658598235846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbcbfa3-039e-4b68-abc8-658598235846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7ef61e-d964-41f6-b950-6af3001b106b', 'volume_name': 'volume-dc7ef61e-d964-41f6-b950-6af3001b106b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83913827-fe25-4e50-b5dd-86b036b23b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83913827-fe25-4e50-b5dd-86b036b23b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1139ce-0eaf-4391-936b-5b44827441ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Volume dc7ef61e-d964-41f6-b950-6af3001b106b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7ef61e-d964-41f6-b950-6af3001b106b', 'volume_size': 1} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d 1073741824" returned: 0 in 0.601s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:16 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d Sep 12 07:24:16 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:16 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1598323020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7ef61e-d964-41f6-b950-6af3001b106b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a678690c093343f781e8fc867047a765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:16Z,use_quota=True,user_id='3fa55ac46020476599efe93b5bddaef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Creating volume dc7ef61e-d964-41f6-b950-6af3001b106b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:16 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebdc1a7-89e9-4df3-89cd-0eb8feec95a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c448e4-e165-46cd-aad5-b5b30bd5eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:16 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b 1073741824 Sep 12 07:24:16 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Volume volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d (7bfa531f-d942-47ae-8e9b-6dfd2e19190d): created successfully Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c448e4-e165-46cd-aad5-b5b30bd5eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Flow 'volume_create_manager' (9fcd669e-6470-41fe-8d81-953a3dc8ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9834f306-d42e-455e-8540-91e708e17873 tempest-GroupsTest-587551071 None] Created volume successfully. Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "cinder-quobyte-2ec580f4-cb5c-4158-98ee-d014ab8d33db" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-quobyte-2ec580f4-cb5c-4158-98ee-d014ab8d33db" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc79410-99e4-47bb-839a-c778e9a6a676]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:16 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:24:16 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:16 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b 1073741824" returned: 0 in 0.441s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:16 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b Sep 12 07:24:16 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:16 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:16 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db Sep 12 07:24:16 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:16 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b" returned: 0 in 0.252s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1139ce-0eaf-4391-936b-5b44827441ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7ef61e-d964-41f6-b950-6af3001b106b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8225c0d3-9c3e-4780-ad4d-5bfc2ab3e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Volume volume-dc7ef61e-d964-41f6-b950-6af3001b106b (dc7ef61e-d964-41f6-b950-6af3001b106b): created successfully Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8225c0d3-9c3e-4780-ad4d-5bfc2ab3e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Flow 'volume_create_manager' (b1f11a3d-3a7d-4679-a4c4-0c5c5497ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-09feb555-e228-469c-b77a-6ab788e5b128 tempest-VolumesMetadataTest-2055029606 None] Created volume successfully. Sep 12 07:24:17 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ec580f4-cb5c-4158-98ee-d014ab8d33db" returned: 0 in 0.252s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-quobyte-2ec580f4-cb5c-4158-98ee-d014ab8d33db" released by "delete_volume" :: held 0.663s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Created reservations ['25253aa9-b626-4cc6-acf8-abdad84ca88e', 'f7102e5d-f59c-4846-a314-80a689c30409', '791bbb77-03f2-4093-8f8c-6cf60be45beb', '664be04a-a737-4d21-93f8-5104fe12c6f6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:17 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:17 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:17 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Deleted volume successfully. Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e2eac538-eb70-481f-9b61-50ca09e27ee0 tempest-VolumesActionsTest-1717267581 None] Lock "cinder-2ec580f4-cb5c-4158-98ee-d014ab8d33db-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Flow 'volume_create_manager' (a46ba5cc-883a-45e7-ac70-aa15d34ec85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff769f2d-19a0-44ef-a98c-0bf8f0c01111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff769f2d-19a0-44ef-a98c-0bf8f0c01111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615939147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6876d06e-7494-4947-88b9-fec4427169fd,host='devstack@QuobyteHD#QuobyteHD',id=7b8bab5c-657e-4519-9dbc-d92323dd704a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c82bbbcd214912a0cd7a92059e1f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:18Z,use_quota=True,user_id='93ab769adecf48c8bc6bcc7a0ef041ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10be4c29-cfde-4c87-a356-da20d19cf7cb),volume_type_id=10be4c29-cfde-4c87-a356-da20d19cf7cb)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaaeab0-92fd-43ba-b983-65d47b60a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaaeab0-92fd-43ba-b983-65d47b60a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259bf0fa-3940-46ff-bf19-970ae2569770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259bf0fa-3940-46ff-bf19-970ae2569770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8bab5c-657e-4519-9dbc-d92323dd704a', 'volume_name': 'volume-7b8bab5c-657e-4519-9dbc-d92323dd704a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a73d84a-329d-4bb6-a057-d8db127fead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a73d84a-329d-4bb6-a057-d8db127fead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9578af57-0475-4728-8fff-55b1c629bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Volume 7b8bab5c-657e-4519-9dbc-d92323dd704a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8bab5c-657e-4519-9dbc-d92323dd704a', 'volume_size': 1} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6876d06e-7494-4947-88b9-fec4427169fd,created_at=2026-09-12T05:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615939147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6876d06e-7494-4947-88b9-fec4427169fd,host='devstack@QuobyteHD#QuobyteHD',id=7b8bab5c-657e-4519-9dbc-d92323dd704a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c82bbbcd214912a0cd7a92059e1f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:18Z,use_quota=True,user_id='93ab769adecf48c8bc6bcc7a0ef041ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10be4c29-cfde-4c87-a356-da20d19cf7cb),volume_type_id=10be4c29-cfde-4c87-a356-da20d19cf7cb)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Creating volume 7b8bab5c-657e-4519-9dbc-d92323dd704a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:17 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:17 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a 1073741824 Sep 12 07:24:17 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:18 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a 1073741824" returned: 0 in 0.543s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:18 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a Sep 12 07:24:18 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Acquiring lock "cinder-dc7ef61e-d964-41f6-b950-6af3001b106b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Lock "cinder-dc7ef61e-d964-41f6-b950-6af3001b106b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:18 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9578af57-0475-4728-8fff-55b1c629bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8bab5c-657e-4519-9dbc-d92323dd704a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342d9b68-bfba-4167-bdb8-68420f1bf262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Acquiring lock "cinder-quobyte-dc7ef61e-d964-41f6-b950-6af3001b106b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Volume volume-7b8bab5c-657e-4519-9dbc-d92323dd704a (7b8bab5c-657e-4519-9dbc-d92323dd704a): created successfully Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342d9b68-bfba-4167-bdb8-68420f1bf262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Flow 'volume_create_manager' (a46ba5cc-883a-45e7-ac70-aa15d34ec85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Lock "cinder-quobyte-dc7ef61e-d964-41f6-b950-6af3001b106b" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d6f84717-086d-4573-93d8-ae127ec1d006 tempest-GroupsTest-587551071 None] Created volume successfully. Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[936226ed-5217-4119-b5b6-2a93b9e0adfc]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:19 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b Sep 12 07:24:19 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9169a3e6-3185-47af-afad-a7173fec4755 tempest-GroupsTest-587551071 None] Update group completed successfully. Sep 12 07:24:19 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b" returned: 0 in 0.399s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:19 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b Sep 12 07:24:19 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:19 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-dc7ef61e-d964-41f6-b950-6af3001b106b" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Lock "cinder-quobyte-dc7ef61e-d964-41f6-b950-6af3001b106b" released by "delete_volume" :: held 0.704s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Created reservations ['86a0ca18-1cb0-4a90-9a52-8f3022564910', 'a71cbb4d-a646-40b2-af5f-5a1e4312f49b', '717e536f-cf3b-4fcf-91c2-109c590a568d', '5d6891f2-82b4-4c04-89d3-6c647daaa384'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:19 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:19 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:19 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:19 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Deleted volume successfully. Sep 12 07:24:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bed8c384-3998-4c5f-8980-81ca051b6a8a tempest-VolumesMetadataTest-2055029606 None] Lock "cinder-dc7ef61e-d964-41f6-b950-6af3001b106b-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ccc73c03-aa78-4210-b066-7a226dc152db tempest-GroupsTest-587551071 None] Update group completed successfully. Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=110,cinder:INSERT=23,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Acquiring lock "cinder-quobyte-7b8bab5c-657e-4519-9dbc-d92323dd704a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Lock "cinder-quobyte-7b8bab5c-657e-4519-9dbc-d92323dd704a" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[384fa83c-35be-4846-b8bc-92955386d90c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:22 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a Sep 12 07:24:22 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:22 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:22 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a Sep 12 07:24:22 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:23 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7b8bab5c-657e-4519-9dbc-d92323dd704a" returned: 0 in 0.288s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Lock "cinder-quobyte-7b8bab5c-657e-4519-9dbc-d92323dd704a" released by "delete_volume" :: held 0.762s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Acquiring lock "cinder-quobyte-7bfa531f-d942-47ae-8e9b-6dfd2e19190d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Lock "cinder-quobyte-7bfa531f-d942-47ae-8e9b-6dfd2e19190d" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e573c1ee-91be-4833-ab3b-3e518d6b250a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:23 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d Sep 12 07:24:23 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:23 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:23 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d Sep 12 07:24:23 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:23 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7bfa531f-d942-47ae-8e9b-6dfd2e19190d" returned: 0 in 0.301s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Lock "cinder-quobyte-7bfa531f-d942-47ae-8e9b-6dfd2e19190d" released by "delete_volume" :: held 0.735s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Created reservations ['ef710183-b7fa-41aa-aba5-8fa35c3899a2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:24 devstack cinder-volume[88013]: WARNING cinder.quota [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-776403950 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-776403950, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:24:24 devstack cinder-volume[88013]: WARNING cinder.quota [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-776403950 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-776403950, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Created reservations ['1427058b-4672-460e-ac4f-621daab2fbf8', '02259373-746f-46c2-9ba7-835f49713bbb', '0893f385-058b-47e9-82e4-c71a37d3a8ac', '31df562e-ea9b-4673-99b2-a5cf9bcc2ad9'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Created reservations ['35ee7d6b-63d4-45d1-b6e8-fd8635281f7c', '004906ca-f11b-473a-b9da-ea9a8845b132', '7b0ea97f-6cb2-4990-b749-25f241890ba1', '9cf38b5b-7fbc-4dc0-bf5b-f4120e2a4ccd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (fa90b1d9-d4cf-4a57-ba70-b07322e3a3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701e4854-7cc7-49b3-bf24-010dc61540b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701e4854-7cc7-49b3-bf24-010dc61540b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-728147838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82944de-204a-4026-bd90-4d2c87a2f9e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:24Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a3de14-6161-4389-97de-c8c2cc536a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a3de14-6161-4389-97de-c8c2cc536a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc052a74-eea2-4408-aaf9-8b2e72c75bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc052a74-eea2-4408-aaf9-8b2e72c75bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82944de-204a-4026-bd90-4d2c87a2f9e0', 'volume_name': 'volume-e82944de-204a-4026-bd90-4d2c87a2f9e0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c58041-6cc1-42ca-bb76-f7a5861868fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c58041-6cc1-42ca-bb76-f7a5861868fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c260092-926f-4e24-9881-30ec77c74d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:24 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Volume e82944de-204a-4026-bd90-4d2c87a2f9e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82944de-204a-4026-bd90-4d2c87a2f9e0', 'volume_size': 1} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-728147838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82944de-204a-4026-bd90-4d2c87a2f9e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:24Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Creating volume e82944de-204a-4026-bd90-4d2c87a2f9e0 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:24 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:24 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 1073741824 Sep 12 07:24:24 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:24 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:24 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:24 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.288s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e95965b8-2fb5-473c-8ecd-758941d80085 tempest-GroupsTest-587551071 None] Delete group completed successfully. Sep 12 07:24:24 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 1073741824" returned: 0 in 0.520s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:24 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 Sep 12 07:24:24 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:25 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c260092-926f-4e24-9881-30ec77c74d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82944de-204a-4026-bd90-4d2c87a2f9e0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a499df0-3a4c-41b8-a092-5fc06db35053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:25 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Volume volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 (e82944de-204a-4026-bd90-4d2c87a2f9e0): created successfully Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a499df0-3a4c-41b8-a092-5fc06db35053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:25 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (fa90b1d9-d4cf-4a57-ba70-b07322e3a3ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-79351fd9-0cd1-4540-8bce-89afebc18167 tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (895a5f9e-997e-4372-8f0d-47592c2cde9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbf65ff-1650-46d5-a001-3659184bbf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbf65ff-1650-46d5-a001-3659184bbf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1311377043',display_name='tempest-VolumesGetTest-Volume-1085435727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b01e5d-d3d5-4a6a-ba06-e19288dd432d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:27Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6521275-9987-4b11-92df-f17dc22a004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6521275-9987-4b11-92df-f17dc22a004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ebe062-c16f-4d59-b08c-70000d5145ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ebe062-c16f-4d59-b08c-70000d5145ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b01e5d-d3d5-4a6a-ba06-e19288dd432d', 'volume_name': 'volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a4300c-53c2-406f-a7dd-0e6bf94aed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a4300c-53c2-406f-a7dd-0e6bf94aed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be069460-fa41-4f70-afb4-bcdd4e4d9e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:27 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Volume e8b01e5d-d3d5-4a6a-ba06-e19288dd432d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d', 'volume_size': 1} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1311377043',display_name='tempest-VolumesGetTest-Volume-1085435727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b01e5d-d3d5-4a6a-ba06-e19288dd432d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:27Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Creating volume e8b01e5d-d3d5-4a6a-ba06-e19288dd432d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:27 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:27 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d 1073741824 Sep 12 07:24:27 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:27 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d 1073741824" returned: 0 in 0.485s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:28 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d Sep 12 07:24:28 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:28 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be069460-fa41-4f70-afb4-bcdd4e4d9e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414f6265-3b72-4746-815c-a41b3d1aed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:28 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Volume volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d (e8b01e5d-d3d5-4a6a-ba06-e19288dd432d): created successfully Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414f6265-3b72-4746-815c-a41b3d1aed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:28 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (895a5f9e-997e-4372-8f0d-47592c2cde9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-66fe765f-cdc7-4a60-b698-f3778d72b10b tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Lock "cinder-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Flow 'volume_create_manager' (a7334424-47ef-4f43-b329-6225d0450ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a51f61-1234-4cbc-9df0-6354b6d8f08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a51f61-1234-4cbc-9df0-6354b6d8f08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1459603013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d9bef-4989-4a50-aeb7-474245074d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dffb9aeb8f4a26b09c0df0178e5132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:30Z,use_quota=True,user_id='73535fadd4ee4a27aaaad99b40222b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbae9f29-9896-4414-bb95-3e0e9bfc6cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbae9f29-9896-4414-bb95-3e0e9bfc6cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0bd536-b3f5-4915-b9c0-8f7e5e8e1b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0bd536-b3f5-4915-b9c0-8f7e5e8e1b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23d9bef-4989-4a50-aeb7-474245074d99', 'volume_name': 'volume-d23d9bef-4989-4a50-aeb7-474245074d99', 'volume_size': 2}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96a0bc2-85b9-4081-b11f-7cf8235969d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96a0bc2-85b9-4081-b11f-7cf8235969d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55a89d3-5c18-41fb-8abd-5a2b606522d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:29 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Volume d23d9bef-4989-4a50-aeb7-474245074d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23d9bef-4989-4a50-aeb7-474245074d99', 'volume_size': 2} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1459603013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d9bef-4989-4a50-aeb7-474245074d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dffb9aeb8f4a26b09c0df0178e5132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:30Z,use_quota=True,user_id='73535fadd4ee4a27aaaad99b40222b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Creating volume d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:29 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 2147483648 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:29 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 2147483648 Sep 12 07:24:29 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8de702-6219-45d3-82b5-06055923cd56]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:29 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d Sep 12 07:24:29 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:30 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:30 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d Sep 12 07:24:30 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:30 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 2147483648" returned: 0 in 0.538s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:30 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 Sep 12 07:24:30 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:30 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:30 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:30 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d" released by "delete_volume" :: held 0.670s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Created reservations ['50af2133-38af-4721-bd50-f879c3bfba47', 'e9eefd30-6b70-4f74-baf0-d7fc839478d8', '5f9a1c56-1cd1-425f-aec8-ec311ec81e63', 'ffd1b299-cccb-4892-a3e5-c2ee2c65386e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:30 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99" returned: 0 in 0.312s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:30 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:30 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55a89d3-5c18-41fb-8abd-5a2b606522d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23d9bef-4989-4a50-aeb7-474245074d99', 'volume_size': 2}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a70719-c922-4047-b604-843d4d4168bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:30 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Volume volume-d23d9bef-4989-4a50-aeb7-474245074d99 (d23d9bef-4989-4a50-aeb7-474245074d99): created successfully Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a70719-c922-4047-b604-843d4d4168bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Flow 'volume_create_manager' (a7334424-47ef-4f43-b329-6225d0450ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e0691738-070c-4ade-ac9e-c2db08d9d2d0 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Created volume successfully. Sep 12 07:24:30 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.364s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-e82944de-204a-4026-bd90-4d2c87a2f9e0-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:30 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Lock "cinder-e82944de-204a-4026-bd90-4d2c87a2f9e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-e82944de-204a-4026-bd90-4d2c87a2f9e0" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-763dd408-c4d7-468f-aed9-323032e6864a tempest-VolumesGetTest-2027710627 None] Lock "cinder-e8b01e5d-d3d5-4a6a-ba06-e19288dd432d-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-e82944de-204a-4026-bd90-4d2c87a2f9e0" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6acbee5-ef8e-41fc-b3ca-4bbba118c5ae]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:31 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 Sep 12 07:24:31 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:31 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Flow 'volume_create_manager' (cde91f89-b840-4765-a7d2-e41af62d5a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2352be0-f097-4504-9d53-dc4135ff0df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2352be0-f097-4504-9d53-dc4135ff0df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2071562594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7f3638-5d61-4f9a-ba1c-61622816edd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fb5d48273c4951b3dd782423bf19da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:31Z,use_quota=True,user_id='5247649d167f41a5bba474532e9d5950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:31 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0 Sep 12 07:24:31 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62996993-c3fe-4774-a856-4a0b0b33d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62996993-c3fe-4774-a856-4a0b0b33d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09ffff9-046a-49fb-bc10-43a73c0d5ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09ffff9-046a-49fb-bc10-43a73c0d5ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7f3638-5d61-4f9a-ba1c-61622816edd9', 'volume_name': 'volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9490f30d-8fe5-4534-9fa9-da445c572a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9490f30d-8fe5-4534-9fa9-da445c572a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22859dee-fc69-4743-9196-ec6e99a996c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:31 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Volume 5a7f3638-5d61-4f9a-ba1c-61622816edd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9', 'volume_size': 1} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2071562594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7f3638-5d61-4f9a-ba1c-61622816edd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fb5d48273c4951b3dd782423bf19da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:31Z,use_quota=True,user_id='5247649d167f41a5bba474532e9d5950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Creating volume 5a7f3638-5d61-4f9a-ba1c-61622816edd9 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:31 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:31 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 1073741824 Sep 12 07:24:31 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:31 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e82944de-204a-4026-bd90-4d2c87a2f9e0" returned: 0 in 0.279s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-e82944de-204a-4026-bd90-4d2c87a2f9e0" released by "delete_volume" :: held 0.707s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Created reservations ['d6db6a95-d81e-4b7f-ad21-072ae9445146', '5d6076f4-a9cf-4a49-b47f-69c2089f56ac', '435375ca-2a00-4a21-ab52-2ce728f8def6', '9f49b3d3-db40-4ec6-a445-329897f1692b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:31 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:31 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:31 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 1073741824" returned: 0 in 0.474s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:32 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 Sep 12 07:24:32 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:32 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.268s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6f3d7bf0-6d7c-4399-b3e4-c027a00431e4 tempest-VolumesGetTest-2027710627 None] Lock "cinder-e82944de-204a-4026-bd90-4d2c87a2f9e0-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:32 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.308s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22859dee-fc69-4743-9196-ec6e99a996c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d666da-8075-4b1c-a65a-d256ea234dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Creating offline snapshot b8aaba5f-e874-4358-8277-3886f2aae650 of volume d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:24:32 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Volume volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 (5a7f3638-5d61-4f9a-ba1c-61622816edd9): created successfully Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d666da-8075-4b1c-a65a-d256ea234dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Flow 'volume_create_manager' (cde91f89-b840-4765-a7d2-e41af62d5a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f6a8a9-5006-4b9d-a91a-9b34fb47baaf]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:32 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bf12c2dc-d711-4a83-b15e-60358ee58c0f tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Created volume successfully. Sep 12 07:24:32 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 Sep 12 07:24:32 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (19131685-640a-4045-87ba-5b51135cdc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad05f9f-1348-4232-aeee-8c0f4a7c09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad05f9f-1348-4232-aeee-8c0f4a7c09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1705381621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53846ee0-5999-40d0-a5ea-9642d059a844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:33Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9ef964-94fc-4814-b9df-d4fcf2297ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9ef964-94fc-4814-b9df-d4fcf2297ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ca4b48-84d3-4cda-a879-fe93d612b997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ca4b48-84d3-4cda-a879-fe93d612b997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53846ee0-5999-40d0-a5ea-9642d059a844', 'volume_name': 'volume-53846ee0-5999-40d0-a5ea-9642d059a844', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068b435d-9810-4c1b-ba32-1a843961c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068b435d-9810-4c1b-ba32-1a843961c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd935b92-1df2-460c-b6c2-16f1d11a19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:32 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Volume 53846ee0-5999-40d0-a5ea-9642d059a844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53846ee0-5999-40d0-a5ea-9642d059a844', 'volume_size': 1} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:32 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99" returned: 0 in 0.359s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 2G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:32 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 2G Sep 12 07:24:32 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:33 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 2G" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23d9bef-4989-4a50-aeb7-474245074d99 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:33 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23d9bef-4989-4a50-aeb7-474245074d99 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 Sep 12 07:24:33 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:33 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23d9bef-4989-4a50-aeb7-474245074d99 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650" returned: 0 in 0.280s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:33 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 is being set with open permissions: ugo+rw Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:33 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 Sep 12 07:24:33 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:33 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:33 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info Sep 12 07:24:33 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:33 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:33 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info is being set with open permissions: ugo+rw Sep 12 07:24:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:33 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info Sep 12 07:24:33 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:34 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.info" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1705381621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53846ee0-5999-40d0-a5ea-9642d059a844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:33Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Creating volume 53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:34 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:34 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 1073741824 Sep 12 07:24:34 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c8a33a74-b989-497c-aaae-b3e95f97e4b8 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Create snapshot completed successfully Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Acquiring lock "cinder-5a7f3638-5d61-4f9a-ba1c-61622816edd9-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "cinder-5a7f3638-5d61-4f9a-ba1c-61622816edd9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Acquiring lock "cinder-quobyte-5a7f3638-5d61-4f9a-ba1c-61622816edd9" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:34 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 1073741824" returned: 0 in 0.494s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "cinder-quobyte-5a7f3638-5d61-4f9a-ba1c-61622816edd9" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbecb3a-57c8-49e5-a21b-8414b3fe1b0f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:34 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 Sep 12 07:24:34 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:34 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 Sep 12 07:24:34 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:34 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd935b92-1df2-460c-b6c2-16f1d11a19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53846ee0-5999-40d0-a5ea-9642d059a844', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b699b8-61a6-483d-87f8-88ef49a63368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:35 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Volume volume-53846ee0-5999-40d0-a5ea-9642d059a844 (53846ee0-5999-40d0-a5ea-9642d059a844): created successfully Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b699b8-61a6-483d-87f8-88ef49a63368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (19131685-640a-4045-87ba-5b51135cdc40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-dc8753cd-7ef8-42aa-ba32-e5d5f11a632e tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:24:35 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9" returned: 0 in 0.369s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:35 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9 Sep 12 07:24:35 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "cinder-b8aaba5f-e874-4358-8277-3886f2aae650-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-b8aaba5f-e874-4358-8277-3886f2aae650-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "cinder-quobyte-d23d9bef-4989-4a50-aeb7-474245074d99" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-quobyte-d23d9bef-4989-4a50-aeb7-474245074d99" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "cinder-quobyte-b8aaba5f-e874-4358-8277-3886f2aae650" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-quobyte-b8aaba5f-e874-4358-8277-3886f2aae650" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Deleting offline snapshot b8aaba5f-e874-4358-8277-3886f2aae650 of volume d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] snapshot_file for this snap is: volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[26051961-cd19-437c-a579-756c6f36771d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:35 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a7f3638-5d61-4f9a-ba1c-61622816edd9" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "cinder-quobyte-5a7f3638-5d61-4f9a-ba1c-61622816edd9" released by "delete_volume" :: held 0.661s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:35 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 Sep 12 07:24:35 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Created reservations ['b137354f-31a0-43c1-b268-9ee48cfc33fe', 'c51d5992-ba28-4322-a30a-9b1da7fc299f', '980a635c-45d4-49c7-8839-b09e552d99bd', '0c186a83-eb05-4e42-8a68-6ef555582bfb'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:35 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:35 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:35 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d23d9bef-4989-4a50-aeb7-474245074d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde535d-e6e6-4278-850a-843b67822b98]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:35 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Deleted volume successfully. Sep 12 07:24:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ede9dc42-428b-4435-b343-d3ef568fd967 tempest-VolumeQuotasNegativeTestJSON-2079100483 None] Lock "cinder-5a7f3638-5d61-4f9a-ba1c-61622816edd9-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:35 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 Sep 12 07:24:35 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:36 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:36 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 Sep 12 07:24:36 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (fecf7394-dd07-47c5-bd62-47d6dcface52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf3a370-c7aa-4232-b44e-241609a883e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf3a370-c7aa-4232-b44e-241609a883e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1628122174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=53846ee0-5999-40d0-a5ea-9642d059a844,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:36Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413e63a5-14ec-436d-9d30-ecb27bc43211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413e63a5-14ec-436d-9d30-ecb27bc43211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2341f2f-d0a6-4324-8201-e0a1449a5509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2341f2f-d0a6-4324-8201-e0a1449a5509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da', 'volume_name': 'volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da', 'volume_size': 1, 'source_volid': '53846ee0-5999-40d0-a5ea-9642d059a844', 'source_volstatus': 'available'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22f82c0-0fbe-4ef5-ac26-e023e45ddc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22f82c0-0fbe-4ef5-ac26-e023e45ddc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53d2cd6-8b9a-4371-b552-0f949d8cbc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:36 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Volume bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da', 'volume_size': 1, 'source_volid': '53846ee0-5999-40d0-a5ea-9642d059a844', 'source_volstatus': 'available'} Sep 12 07:24:36 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650" returned: 0 in 0.419s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:36 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Cloning volume 53846ee0-5999-40d0-a5ea-9642d059a844 to volume bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da Sep 12 07:24:36 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650 Sep 12 07:24:36 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Creating offline snapshot 4bd293ae-50df-44ab-8190-182ecafd2fc0 of volume 53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff4d2c5-b7c9-4e76-8f6d-7bb6e31d26cc]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:36 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 Sep 12 07:24:36 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:36 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99.b8aaba5f-e874-4358-8277-3886f2aae650" returned: 0 in 0.276s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-quobyte-b8aaba5f-e874-4358-8277-3886f2aae650" released by "_delete_snapshot" :: held 1.578s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-quobyte-d23d9bef-4989-4a50-aeb7-474245074d99" released by "delete_snapshot" :: held 1.602s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:36 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Created reservations ['cf8000d0-14d1-493f-a99d-9764c08997b9', 'df12b003-83ac-43d5-a43d-5eb4607187fe', '14b46e8a-fe07-42ec-bb73-373fd9ef4834', '6f110488-4a7f-48f9-9654-5107ae1fd50b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:37 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Delete snapshot completed successfully. Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-36adde34-54b5-4686-9c5f-268251bc8b44 tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-b8aaba5f-e874-4358-8277-3886f2aae650-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:37 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 1G Sep 12 07:24:37 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "cinder-d23d9bef-4989-4a50-aeb7-474245074d99-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-d23d9bef-4989-4a50-aeb7-474245074d99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:37 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 1G" returned: 0 in 0.511s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53846ee0-5999-40d0-a5ea-9642d059a844 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:37 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53846ee0-5999-40d0-a5ea-9642d059a844 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 Sep 12 07:24:37 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "cinder-quobyte-d23d9bef-4989-4a50-aeb7-474245074d99" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-quobyte-d23d9bef-4989-4a50-aeb7-474245074d99" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[91afb51b-5f24-4824-b4fd-2dfdbc107924]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:37 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 Sep 12 07:24:37 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:37 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53846ee0-5999-40d0-a5ea-9642d059a844 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0" returned: 0 in 0.348s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:37 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 is being set with open permissions: ugo+rw Sep 12 07:24:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:37 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 Sep 12 07:24:37 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:38 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99" returned: 0 in 0.402s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:38 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99 Sep 12 07:24:38 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:38 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0" returned: 0 in 0.259s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:38 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info Sep 12 07:24:38 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:38 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d23d9bef-4989-4a50-aeb7-474245074d99" returned: 0 in 0.255s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-quobyte-d23d9bef-4989-4a50-aeb7-474245074d99" released by "delete_volume" :: held 0.731s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Created reservations ['319805e3-3899-41d1-b513-25f1ce845bc6', 'a221b304-613c-4883-b5cb-3c2fdbf03112', '62f3ebfb-d35d-4243-87ac-ef8978f65486', '39aaec0f-749b-4a79-9406-be7fa5199f5d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:38 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info" returned: 0 in 0.305s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:38 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info is being set with open permissions: ugo+rw Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:38 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info Sep 12 07:24:38 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:38 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:38 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:38 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.info" returned: 0 in 0.284s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] snapshot: 4bd293ae-50df-44ab-8190-182ecafd2fc0, volume: bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:38 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:38 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Deleted volume successfully. Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0920a40e-adfe-48ac-94f1-1afe201fe9f4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-92e435a4-d4f3-46eb-bbe5-b604a4c3647e tempest-VolumesSnapshotNegativeTestJSON-743274682 None] Lock "cinder-d23d9bef-4989-4a50-aeb7-474245074d99-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:38 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 Sep 12 07:24:38 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:39 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0" returned: 0 in 0.390s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53846ee0-5999-40d0-a5ea-9642d059a844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96c57c-2e10-4df6-ad4e-267bfa4c6192]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:39 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 Sep 12 07:24:39 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:39 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844" returned: 0 in 0.444s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:24:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:39 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da Sep 12 07:24:39 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:44 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" returned: 0 in 5.202s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:44 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:24:44 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Converted 1024.00 MB image at 196.82 MB/s Sep 12 07:24:44 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da is being set with open permissions: ugo+rw Sep 12 07:24:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:44 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da Sep 12 07:24:44 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:45 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" released by "_copy_volume_from_snapshot" :: held 6.374s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-4bd293ae-50df-44ab-8190-182ecafd2fc0" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-4bd293ae-50df-44ab-8190-182ecafd2fc0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Deleting offline snapshot 4bd293ae-50df-44ab-8190-182ecafd2fc0 of volume 53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] snapshot_file for this snap is: volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c07673a-1591-4763-9908-8ac0ccccb90c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:45 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 Sep 12 07:24:45 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:45 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0" returned: 0 in 0.385s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53846ee0-5999-40d0-a5ea-9642d059a844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f27f30-e625-471e-8e63-e5155a0f0e77]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:45 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 Sep 12 07:24:45 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=106,cinder:UPDATE=138,cinder:INSERT=27,cinder:DELETE=11 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Flow 'volume_create_manager' (d8d4d20c-6c51-4c0d-aabf-e3778a6237d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a4fec3-1bdf-427e-abc2-7da330c0884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a4fec3-1bdf-427e-abc2-7da330c0884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-800342760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e896b9-1def-4bf7-98fb-daebf30636bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7cc86d69a04b0fb768432fdbd2b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:46Z,use_quota=True,user_id='c4743140a2f7421aae4370a366b4c5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f786443e-5eda-4a92-a5c0-e1ccfe140744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f786443e-5eda-4a92-a5c0-e1ccfe140744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05515844-7d22-4375-8488-7906248f663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05515844-7d22-4375-8488-7906248f663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e896b9-1def-4bf7-98fb-daebf30636bf', 'volume_name': 'volume-61e896b9-1def-4bf7-98fb-daebf30636bf', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9bdf1a-d3bb-48cf-b132-8d5ffcbe02ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9bdf1a-d3bb-48cf-b132-8d5ffcbe02ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c465fcf8-4d90-4746-8df9-c42fdf63fb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:45 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Volume 61e896b9-1def-4bf7-98fb-daebf30636bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e896b9-1def-4bf7-98fb-daebf30636bf', 'volume_size': 1} Sep 12 07:24:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:46 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844" returned: 0 in 0.573s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:46 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 Sep 12 07:24:46 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:46 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0" returned: 0 in 0.335s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:46 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0 Sep 12 07:24:46 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:46 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844.4bd293ae-50df-44ab-8190-182ecafd2fc0" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-4bd293ae-50df-44ab-8190-182ecafd2fc0" released by "_delete_snapshot" :: held 1.674s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.384s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-800342760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e896b9-1def-4bf7-98fb-daebf30636bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7cc86d69a04b0fb768432fdbd2b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:46Z,use_quota=True,user_id='c4743140a2f7421aae4370a366b4c5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Creating volume 61e896b9-1def-4bf7-98fb-daebf30636bf {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:46 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53d2cd6-8b9a-4371-b552-0f949d8cbc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da', 'volume_size': 1, 'source_volid': '53846ee0-5999-40d0-a5ea-9642d059a844', 'source_volstatus': 'available'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:46 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf 1073741824 Sep 12 07:24:46 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2666a2a1-9ce2-4e7a-9d67-115490ea6e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Volume volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da (bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da): created successfully Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2666a2a1-9ce2-4e7a-9d67-115490ea6e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (fecf7394-dd07-47c5-bd62-47d6dcface52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6fdd3a6e-dd08-489d-af2f-34db2e2b0119 tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:24:47 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf 1073741824" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:47 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf Sep 12 07:24:47 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:47 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c465fcf8-4d90-4746-8df9-c42fdf63fb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e896b9-1def-4bf7-98fb-daebf30636bf', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5173ebc0-9e54-4cf1-bf29-96c2dce0cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Volume volume-61e896b9-1def-4bf7-98fb-daebf30636bf (61e896b9-1def-4bf7-98fb-daebf30636bf): created successfully Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5173ebc0-9e54-4cf1-bf29-96c2dce0cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Flow 'volume_create_manager' (d8d4d20c-6c51-4c0d-aabf-e3778a6237d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c6425940-7ef9-4eb6-b601-2176edb7796d tempest-VolumesServicesTestJSON-1324521651 None] Created volume successfully. Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Acquiring lock "cinder-61e896b9-1def-4bf7-98fb-daebf30636bf-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Lock "cinder-61e896b9-1def-4bf7-98fb-daebf30636bf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Acquiring lock "cinder-quobyte-61e896b9-1def-4bf7-98fb-daebf30636bf" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Lock "cinder-quobyte-61e896b9-1def-4bf7-98fb-daebf30636bf" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[06887a31-827e-4e86-9cc6-5a4f9f37a2b6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (734eacca-e105-4c2e-81b2-10ca8db52fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f3a334-3b20-437a-9cdb-f5b018a51808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f3a334-3b20-437a-9cdb-f5b018a51808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-924775316',display_name='tempest-VolumesGetTest-Volume-680168784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa8ed0c-1977-4457-ac6f-743d70f0ac19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:48Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb64558-1091-4166-8cd2-dddd7fc4a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb64558-1091-4166-8cd2-dddd7fc4a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3fa9b7-1c04-4378-a402-3030e0151982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3fa9b7-1c04-4378-a402-3030e0151982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa8ed0c-1977-4457-ac6f-743d70f0ac19', 'volume_name': 'volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838524ff-3a41-45f0-949b-628c6569ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838524ff-3a41-45f0-949b-628c6569ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c18a333-96ac-4db8-bf66-e37da22ba5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Volume caa8ed0c-1977-4457-ac6f-743d70f0ac19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19', 'volume_size': 1} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-924775316',display_name='tempest-VolumesGetTest-Volume-680168784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa8ed0c-1977-4457-ac6f-743d70f0ac19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:48Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Creating volume caa8ed0c-1977-4457-ac6f-743d70f0ac19 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:48 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf Sep 12 07:24:48 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:48 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:48 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 1073741824 Sep 12 07:24:48 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:48 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf" returned: 0 in 0.402s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:48 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf Sep 12 07:24:48 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:48 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 1073741824" returned: 0 in 0.500s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:48 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:48 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-61e896b9-1def-4bf7-98fb-daebf30636bf" returned: 0 in 0.290s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:48 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Lock "cinder-quobyte-61e896b9-1def-4bf7-98fb-daebf30636bf" released by "delete_volume" :: held 0.747s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Created reservations ['291f8a8a-a22d-4a33-91ca-0227535446f5', '77d11bba-2017-4b3c-acf7-95362c0d2906', '11d7fda5-bfad-483d-aac7-527b9f715e86', '669e7a33-4297-465c-b062-379f59149e64'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Flow 'volume_create_manager' (24b94705-9657-4812-8d44-862ed5e339ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eda315-e3f6-4102-b460-442868192dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eda315-e3f6-4102-b460-442868192dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c818466-1e33-4bf6-a08b-73d7de65fb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48987770fb2e4655b4f807113672a8ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:49Z,use_quota=True,user_id='71552dea144445dda90f79b99bd3a8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7159c20f-8317-424d-b8c9-e7fdab7d1b8a),volume_type_id=7159c20f-8317-424d-b8c9-e7fdab7d1b8a)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad68784-ab73-464c-99ed-13827fa27dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad68784-ab73-464c-99ed-13827fa27dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee035c3-3465-4016-bc73-cfad3465965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:49 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:49 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:49 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c18a333-96ac-4db8-bf66-e37da22ba5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18817d2-9c0e-4108-97e0-dd832e2d1198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Volume volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 (caa8ed0c-1977-4457-ac6f-743d70f0ac19): created successfully Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18817d2-9c0e-4108-97e0-dd832e2d1198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (734eacca-e105-4c2e-81b2-10ca8db52fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-29ea9c44-9531-4418-b150-5d2ab3379eaf tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee035c3-3465-4016-bc73-cfad3465965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c818466-1e33-4bf6-a08b-73d7de65fb10', 'volume_name': 'volume-9c818466-1e33-4bf6-a08b-73d7de65fb10', 'volume_size': 1, 'image_id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9825a613-c82c-435b-87ec-f00cd5aeac85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '76896af2d78d1637aa01ed590fe23c25', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48987770fb2e4655b4f807113672a8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '092344e98fb809f068806aee6d867a3961afdb416acceec0dcfc44a8289718ed337410c19bdbf6d1548e0286117b6e0175eb39bf8c16c7b83bf919744b695247', 'id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'created_at': datetime.datetime(2026, 9, 12, 5, 24, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 24, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9825a613-c82c-435b-87ec-f00cd5aeac85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b99afe-0f61-422b-9cd4-5e44a93a53e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b99afe-0f61-422b-9cd4-5e44a93a53e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7267ea8-536f-4f82-882c-4702242849d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Volume 9c818466-1e33-4bf6-a08b-73d7de65fb10: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c818466-1e33-4bf6-a08b-73d7de65fb10', 'volume_size': 1, 'image_id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9825a613-c82c-435b-87ec-f00cd5aeac85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '76896af2d78d1637aa01ed590fe23c25', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48987770fb2e4655b4f807113672a8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '092344e98fb809f068806aee6d867a3961afdb416acceec0dcfc44a8289718ed337410c19bdbf6d1548e0286117b6e0175eb39bf8c16c7b83bf919744b695247', 'id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'created_at': datetime.datetime(2026, 9, 12, 5, 24, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 24, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9825a613-c82c-435b-87ec-f00cd5aeac85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Trying to clone 9c818466-1e33-4bf6-a08b-73d7de65fb10 from image 9825a613-c82c-435b-87ec-f00cd5aeac85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9825a613-c82c-435b-87ec-f00cd5aeac85', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:24:49 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Deleted volume successfully. Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c578cace-6df3-4776-ac57-1a94b9753961 tempest-VolumesServicesTestJSON-1324521651 None] Lock "cinder-61e896b9-1def-4bf7-98fb-daebf30636bf-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:24:49 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Image download 0.00 MB at 0.00 MB/s Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e2d178-d35c-4c52-b877-526b767d4764]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:49 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD Sep 12 07:24:49 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:49 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:50 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD Sep 12 07:24:50 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:50 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Temporary image 9825a613-c82c-435b-87ec-f00cd5aeac85 is fetched for user 71552dea144445dda90f79b99bd3a8c4. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad99f5-e476-418f-a03b-c22f916946db]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-caa8ed0c-1977-4457-ac6f-743d70f0ac19-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Lock "cinder-caa8ed0c-1977-4457-ac6f-743d70f0ac19-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:50 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD Sep 12 07:24:50 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-caa8ed0c-1977-4457-ac6f-743d70f0ac19" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-caa8ed0c-1977-4457-ac6f-743d70f0ac19" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e687e3bf-e977-4ed7-a64f-4ab27f94c869]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:50 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 Sep 12 07:24:50 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:50 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:50 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD Sep 12 07:24:50 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:51 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19" returned: 0 in 0.429s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:51 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19 Sep 12 07:24:51 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:51 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c818466-1e33-4bf6-a08b-73d7de65fb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48987770fb2e4655b4f807113672a8ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:49Z,use_quota=True,user_id='71552dea144445dda90f79b99bd3a8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7159c20f-8317-424d-b8c9-e7fdab7d1b8a),volume_type_id=7159c20f-8317-424d-b8c9-e7fdab7d1b8a)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Creating volume 9c818466-1e33-4bf6-a08b-73d7de65fb10 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:51 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:51 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 1073741824 Sep 12 07:24:51 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:51 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-caa8ed0c-1977-4457-ac6f-743d70f0ac19" returned: 0 in 0.268s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-caa8ed0c-1977-4457-ac6f-743d70f0ac19" released by "delete_volume" :: held 0.745s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Created reservations ['9e1d9230-9242-4838-a1b8-38af1c3d36f6', '6d6275ae-051e-409b-b5c7-be78e6b97fba', '814acb8f-d22a-449e-9dbe-08f3a1d8755d', '38890678-118f-48bf-854b-b73b54fe3b75'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:51 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:51 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:51 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 1073741824" returned: 0 in 0.517s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:51 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.304s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb57d2a6-b079-446f-a75c-b313b63692aa tempest-VolumesGetTest-2027710627 None] Lock "cinder-caa8ed0c-1977-4457-ac6f-743d70f0ac19-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:51 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 Sep 12 07:24:51 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Lock "cinder-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0b72c-9ed0-4048-95fc-48cd27b35092]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:52 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da Sep 12 07:24:52 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:52 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Attempting download of 9825a613-c82c-435b-87ec-f00cd5aeac85 ((None, [{'url': 'file:///opt/stack/data/glance/images/9825a613-c82c-435b-87ec-f00cd5aeac85', 'metadata': {}}])) to volume 9c818466-1e33-4bf6-a08b-73d7de65fb10. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed595da4-e842-4b86-b29a-fbfb84a113e4]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:52 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt Sep 12 07:24:52 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:52 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" returned: 0 in 0.430s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:52 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da Sep 12 07:24:52 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:52 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt" returned: 0 in 0.361s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:52 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da" released by "delete_volume" :: held 0.729s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:52 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt Sep 12 07:24:52 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Created reservations ['e919aeb6-08be-4fb2-b375-47b1ec81c5e6', '9c1b4401-6797-4e87-93f6-5d8d4e91562e', '9ec0ddd9-e7cb-4ccf-ad5c-c877c2443668', '2b8ff345-ce5c-4c05-bead-1c4c5f20bef0'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:52 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:52 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:52 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt" returned: 1 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9825a613-c82c-435b-87ec-f00cd5aeac85_dcuywjnt' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[525709ed-330c-43f8-b82e-d065390d1518]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:53 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD Sep 12 07:24:53 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:53 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.287s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:53 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-53846ee0-5999-40d0-a5ea-9642d059a844-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ca9d0b13-b9b6-4307-af6c-ae32a86bdabb tempest-VolumesGetTest-2027710627 None] Lock "cinder-bb4aa5ef-fdb0-46ff-a6de-2de2f228d9da-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Lock "cinder-53846ee0-5999-40d0-a5ea-9642d059a844-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-53846ee0-5999-40d0-a5ea-9642d059a844" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-53846ee0-5999-40d0-a5ea-9642d059a844" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e29041d-e716-4f09-9466-e50cd895f300]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:53 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:53 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 Sep 12 07:24:53 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:53 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD Sep 12 07:24:53 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:53 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:53 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] 9825a613-c82c-435b-87ec-f00cd5aeac85 was raw, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:53 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844 Sep 12 07:24:53 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:53 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 Sep 12 07:24:53 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:53 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-53846ee0-5999-40d0-a5ea-9642d059a844" returned: 0 in 0.264s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-53846ee0-5999-40d0-a5ea-9642d059a844" released by "delete_volume" :: held 0.723s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Created reservations ['50dcd75c-e005-4e74-b2a0-f6d76cb577c7', 'a80f5836-65c9-4895-aaa4-2ecd18bf3573', '1a67dc3d-52e9-4438-940d-8df4b688f4fd', '34c7e3a0-6023-4507-a723-7134048e6229'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:54 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:54 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:54 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10" returned: 0 in 0.481s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9825a613-c82c-435b-87ec-f00cd5aeac85_olvf4m6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:24:54 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Converted 0.00 MB image at 0.00 MB/s Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:54 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 1G Sep 12 07:24:54 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:54 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.302s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-beca11bd-1a2d-4934-8695-d35497fadd06 tempest-VolumesGetTest-2027710627 None] Lock "cinder-53846ee0-5999-40d0-a5ea-9642d059a844-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:54 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 1G" returned: 0 in 0.378s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Downloaded image 9825a613-c82c-435b-87ec-f00cd5aeac85 ((None, [{'url': 'file:///opt/stack/data/glance/images/9825a613-c82c-435b-87ec-f00cd5aeac85', 'metadata': {}}])) to volume 9c818466-1e33-4bf6-a08b-73d7de65fb10 successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Temporary image 9825a613-c82c-435b-87ec-f00cd5aeac85 for user 71552dea144445dda90f79b99bd3a8c4 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Marking volume 9c818466-1e33-4bf6-a08b-73d7de65fb10 as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Copying metadata from image 9825a613-c82c-435b-87ec-f00cd5aeac85 to 9c818466-1e33-4bf6-a08b-73d7de65fb10. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Creating volume glance metadata for volume 9c818466-1e33-4bf6-a08b-73d7de65fb10 backed by image 9825a613-c82c-435b-87ec-f00cd5aeac85 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '76896af2d78d1637aa01ed590fe23c25', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7267ea8-536f-4f82-882c-4702242849d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c818466-1e33-4bf6-a08b-73d7de65fb10', 'volume_size': 1, 'image_id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9825a613-c82c-435b-87ec-f00cd5aeac85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '76896af2d78d1637aa01ed590fe23c25', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48987770fb2e4655b4f807113672a8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '092344e98fb809f068806aee6d867a3961afdb416acceec0dcfc44a8289718ed337410c19bdbf6d1548e0286117b6e0175eb39bf8c16c7b83bf919744b695247', 'id': '9825a613-c82c-435b-87ec-f00cd5aeac85', 'created_at': datetime.datetime(2026, 9, 12, 5, 24, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 24, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9825a613-c82c-435b-87ec-f00cd5aeac85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55775d28-4663-409f-91d9-c73ed507bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Volume volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 (9c818466-1e33-4bf6-a08b-73d7de65fb10): created successfully Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55775d28-4663-409f-91d9-c73ed507bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Flow 'volume_create_manager' (24b94705-9657-4812-8d44-862ed5e339ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5c22a939-1b34-41be-9992-a82db7491836 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Created volume successfully. Sep 12 07:24:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (272db66b-ad9d-467a-8c86-f34dba7ff5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7077ded-fbe5-45af-975e-f234b6e547b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7077ded-fbe5-45af-975e-f234b6e547b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-329485485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd803fb6-fec3-4fc0-bb07-d87aa86524fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:55Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc36766d-edbc-48f8-913f-a696f457b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc36766d-edbc-48f8-913f-a696f457b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d3be16-1da8-434f-b27b-fa3b8c5411c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d3be16-1da8-434f-b27b-fa3b8c5411c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd803fb6-fec3-4fc0-bb07-d87aa86524fe', 'volume_name': 'volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c3a3c5-cbad-4afe-8752-2b2b56aeb1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c3a3c5-cbad-4afe-8752-2b2b56aeb1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfa7217-d4ff-4cba-b6c2-8d70e50b439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:55 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Volume fd803fb6-fec3-4fc0-bb07-d87aa86524fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Trying to clone fd803fb6-fec3-4fc0-bb07-d87aa86524fe from image a5243768-15a1-4db8-a379-25d46ec5cd8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Acquiring lock "cinder-9c818466-1e33-4bf6-a08b-73d7de65fb10-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "cinder-9c818466-1e33-4bf6-a08b-73d7de65fb10-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Acquiring lock "cinder-quobyte-9c818466-1e33-4bf6-a08b-73d7de65fb10" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "cinder-quobyte-9c818466-1e33-4bf6-a08b-73d7de65fb10" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b4df51-0b6d-4da7-bd68-5423d3aa7b0a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:24:55 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Image download 20.69 MB at 20.69 MB/s Sep 12 07:24:55 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 Sep 12 07:24:55 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd64fd-6d46-47f1-a2e4-215ee3fe38f0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:55 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD Sep 12 07:24:55 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Flow 'volume_create_manager' (ebdb8b12-0850-4372-bfb8-d4a6a75410de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c34ca3a-85d5-4900-b45c-a9402778898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c34ca3a-85d5-4900-b45c-a9402778898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1409662628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a052913-9bd1-4f74-92ca-3ed33fdebc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa8074531cc48649bdf13ffef20b89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:56Z,use_quota=True,user_id='2346f833e9f14de1a488d61049e617ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb2f42a-0d74-423e-b86d-f0b715966c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb2f42a-0d74-423e-b86d-f0b715966c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910e2f1-7d3a-4bec-95f5-7cf20ee085c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910e2f1-7d3a-4bec-95f5-7cf20ee085c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a052913-9bd1-4f74-92ca-3ed33fdebc88', 'volume_name': 'volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12021da7-e530-494b-90f5-52b2859884f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12021da7-e530-494b-90f5-52b2859884f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566c35b9-2b2d-4dcb-84f0-379ab730cce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:56 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Volume 3a052913-9bd1-4f74-92ca-3ed33fdebc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88', 'volume_size': 1} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1409662628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a052913-9bd1-4f74-92ca-3ed33fdebc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa8074531cc48649bdf13ffef20b89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:56Z,use_quota=True,user_id='2346f833e9f14de1a488d61049e617ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Creating volume 3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:56 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:56 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 1073741824 Sep 12 07:24:56 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10" returned: 0 in 0.466s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:56 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10 Sep 12 07:24:56 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c is fetched for user aded170276fc452696ff3d52f73ef3c3. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f751d2-a407-4b23-b73a-08c61e19df03]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:56 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD Sep 12 07:24:56 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9c818466-1e33-4bf6-a08b-73d7de65fb10" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "cinder-quobyte-9c818466-1e33-4bf6-a08b-73d7de65fb10" released by "delete_volume" :: held 0.789s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:56 devstack cinder-volume[88013]: WARNING cinder.quota [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:24:56 devstack cinder-volume[88013]: WARNING cinder.quota [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Created reservations ['7130a93a-a5fd-42e5-b4e1-1f6c4dee995f', '74b3d754-7950-4091-86a5-c76e0ae66942', '775baf4c-04b5-46a3-89b5-e89a7616edb1', '0e0fc384-ccf5-48a7-b73b-e58dce54d416'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:56 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 1073741824" returned: 0 in 0.459s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:24:56 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:56 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 Sep 12 07:24:56 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:56 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:24:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Deleted volume successfully. Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d54670f0-934d-41da-98f4-8a005fb57104 tempest-VolumeAndVolumeTypeFromImageTest-1778771058 None] Lock "cinder-9c818466-1e33-4bf6-a08b-73d7de65fb10-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:24:56 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88" returned: 0 in 0.329s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-329485485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd803fb6-fec3-4fc0-bb07-d87aa86524fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:24:55Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Creating volume fd803fb6-fec3-4fc0-bb07-d87aa86524fe {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:24:56 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566c35b9-2b2d-4dcb-84f0-379ab730cce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5cf851-1f0a-48c5-abfb-0a7ce1d8a8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:24:56 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe 1073741824 Sep 12 07:24:56 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:56 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Volume volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 (3a052913-9bd1-4f74-92ca-3ed33fdebc88): created successfully Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5cf851-1f0a-48c5-abfb-0a7ce1d8a8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:24:56 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Flow 'volume_create_manager' (ebdb8b12-0850-4372-bfb8-d4a6a75410de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:24:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2dcef498-2fff-4acb-938d-83830402ca24 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Created volume successfully. Sep 12 07:24:57 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe 1073741824" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:57 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe Sep 12 07:24:57 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:57 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Attempting download of a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume fd803fb6-fec3-4fc0-bb07-d87aa86524fe. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30920c7-ee20-4af6-97c4-39e77cd30b25]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:57 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp Sep 12 07:24:57 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:58 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp" returned: 0 in 0.336s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:58 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp Sep 12 07:24:58 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Creating offline snapshot 9787ce0f-0e29-448f-8c68-498c891aa1d7 of volume 3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[38598784-2bbf-456e-91a6-d0df18b3b65b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:58 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp" returned: 1 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_l_dn0ijp' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[353e2a28-d7ed-4719-8563-c94dbd12cee5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:58 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 Sep 12 07:24:58 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:58 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD Sep 12 07:24:58 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:58 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88" returned: 0 in 0.421s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:58 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 1G Sep 12 07:24:58 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:58 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] a5243768-15a1-4db8-a379-25d46ec5cd8c was qcow2, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:24:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:58 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe Sep 12 07:24:58 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:59 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 1G" returned: 0 in 0.445s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:59 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 Sep 12 07:24:59 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:59 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:59 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 is being set with open permissions: ugo+rw Sep 12 07:24:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:59 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 Sep 12 07:24:59 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:24:59 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 12 07:24:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7" returned: 0 in 0.261s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:24:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:24:59 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info Sep 12 07:24:59 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:00 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info" returned: 0 in 0.317s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:00 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info is being set with open permissions: ugo+rw Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:00 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info Sep 12 07:25:00 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:00 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.info" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-920068ae-4cc6-42ce-a651-240fe58e0b6e tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Create snapshot completed successfully Sep 12 07:25:00 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" returned: 0 in 1.954s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_7q60ndgjdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:25:00 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Converted 112.00 MB image at 57.28 MB/s Sep 12 07:25:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:00 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe 1G Sep 12 07:25:00 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:01 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe 1G" returned: 0 in 0.334s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Downloaded image a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume fd803fb6-fec3-4fc0-bb07-d87aa86524fe successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c for user aded170276fc452696ff3d52f73ef3c3 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Marking volume fd803fb6-fec3-4fc0-bb07-d87aa86524fe as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Copying metadata from image a5243768-15a1-4db8-a379-25d46ec5cd8c to fd803fb6-fec3-4fc0-bb07-d87aa86524fe. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Creating volume glance metadata for volume fd803fb6-fec3-4fc0-bb07-d87aa86524fe backed by image a5243768-15a1-4db8-a379-25d46ec5cd8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfa7217-d4ff-4cba-b6c2-8d70e50b439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dcb826-c8b7-4d93-af10-ec2a238cc2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Volume volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe (fd803fb6-fec3-4fc0-bb07-d87aa86524fe): created successfully Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dcb826-c8b7-4d93-af10-ec2a238cc2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (272db66b-ad9d-467a-8c86-f34dba7ff5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-20afd5de-db23-4a64-8c17-40fd9517abdd tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "cinder-9787ce0f-0e29-448f-8c68-498c891aa1d7-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-9787ce0f-0e29-448f-8c68-498c891aa1d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "cinder-quobyte-3a052913-9bd1-4f74-92ca-3ed33fdebc88" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-quobyte-3a052913-9bd1-4f74-92ca-3ed33fdebc88" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "cinder-quobyte-9787ce0f-0e29-448f-8c68-498c891aa1d7" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-quobyte-9787ce0f-0e29-448f-8c68-498c891aa1d7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Deleting offline snapshot 9787ce0f-0e29-448f-8c68-498c891aa1d7 of volume 3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] snapshot_file for this snap is: volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c6e446-f709-4561-8f70-1094592a2044]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (ba08a908-a44b-4fa8-bb19-0e72c1d88cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4ed770-f009-4391-9759-9e9526ca0af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4ed770-f009-4391-9759-9e9526ca0af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1136557521',display_name='tempest-VolumesGetTest-Volume-2067101022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cf0740-03e2-4e18-8c19-1008b4ac0f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:02Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9f8dff-ef0a-40a2-b040-eb5893a6eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9f8dff-ef0a-40a2-b040-eb5893a6eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:02 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 Sep 12 07:25:02 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0ccc10-2766-4a30-b8cc-5aac60ac333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0ccc10-2766-4a30-b8cc-5aac60ac333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89cf0740-03e2-4e18-8c19-1008b4ac0f7b', 'volume_name': 'volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6224174-cc14-4815-bf68-1818ee488e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6224174-cc14-4815-bf68-1818ee488e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b855a560-9912-4dad-953e-5eca6ac771f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:02 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Volume 89cf0740-03e2-4e18-8c19-1008b4ac0f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b', 'volume_size': 1} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1136557521',display_name='tempest-VolumesGetTest-Volume-2067101022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cf0740-03e2-4e18-8c19-1008b4ac0f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4890dc15f42aab777795a8ae48cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:02Z,use_quota=True,user_id='aded170276fc452696ff3d52f73ef3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Creating volume 89cf0740-03e2-4e18-8c19-1008b4ac0f7b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:02 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:02 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b 1073741824 Sep 12 07:25:02 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:02 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7" returned: 0 in 0.400s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf962b9-7858-4300-94a3-cbdb68b95ddd]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:02 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 Sep 12 07:25:02 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:02 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b 1073741824" returned: 0 in 0.503s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:02 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b Sep 12 07:25:02 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:03 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:03 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 Sep 12 07:25:03 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:03 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b" returned: 0 in 0.280s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b855a560-9912-4dad-953e-5eca6ac771f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de398d6-ada8-448a-bc4c-a98ae6d5114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:03 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Volume volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b (89cf0740-03e2-4e18-8c19-1008b4ac0f7b): created successfully Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de398d6-ada8-448a-bc4c-a98ae6d5114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Flow 'volume_create_manager' (ba08a908-a44b-4fa8-bb19-0e72c1d88cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:03 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-273c907f-1920-4a7e-a3e4-c475a702c126 tempest-VolumesGetTest-2027710627 None] Created volume successfully. Sep 12 07:25:03 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7" returned: 0 in 0.374s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:03 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7 Sep 12 07:25:03 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:03 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88.9787ce0f-0e29-448f-8c68-498c891aa1d7" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-quobyte-9787ce0f-0e29-448f-8c68-498c891aa1d7" released by "_delete_snapshot" :: held 1.563s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-quobyte-3a052913-9bd1-4f74-92ca-3ed33fdebc88" released by "delete_snapshot" :: held 1.590s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Created reservations ['7f6e1fa3-b1a2-42d9-8107-9e796bdb9aa3', '2cfa44e2-3f5c-41ba-bcd6-35d68dab64f2', '1fc57b92-0a4a-4297-95f1-c68b612f0ab8', '90d1b0f5-b3b1-4181-a63b-457b6fd2b12a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:03 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Delete snapshot completed successfully. Sep 12 07:25:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-179a39d2-3fc2-4788-8d7a-ff1c06068c98 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-9787ce0f-0e29-448f-8c68-498c891aa1d7-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "cinder-3a052913-9bd1-4f74-92ca-3ed33fdebc88-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-3a052913-9bd1-4f74-92ca-3ed33fdebc88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "cinder-quobyte-3a052913-9bd1-4f74-92ca-3ed33fdebc88" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-89cf0740-03e2-4e18-8c19-1008b4ac0f7b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-quobyte-3a052913-9bd1-4f74-92ca-3ed33fdebc88" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Lock "cinder-89cf0740-03e2-4e18-8c19-1008b4ac0f7b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe19f96-0e2e-420b-a822-95993f407470]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-89cf0740-03e2-4e18-8c19-1008b4ac0f7b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-89cf0740-03e2-4e18-8c19-1008b4ac0f7b" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01de13e-7e1a-4756-8a81-25ae0ffa6b29]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:04 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 Sep 12 07:25:04 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:04 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b Sep 12 07:25:04 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:04 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:05 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88 Sep 12 07:25:05 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:05 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b" returned: 0 in 0.415s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:05 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b Sep 12 07:25:05 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:05 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3a052913-9bd1-4f74-92ca-3ed33fdebc88" returned: 0 in 0.275s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-quobyte-3a052913-9bd1-4f74-92ca-3ed33fdebc88" released by "delete_volume" :: held 0.765s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:05 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89cf0740-03e2-4e18-8c19-1008b4ac0f7b" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Created reservations ['3653b19f-590a-4470-bd88-93ecfd3fb4f7', 'a4e01661-f427-41c5-9c87-9ad54478fd04', '00807f91-208c-4ba7-bd6a-7f1f3c540705', 'd8eb208c-b00b-4ff8-9844-6946da163a65'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-89cf0740-03e2-4e18-8c19-1008b4ac0f7b" released by "delete_volume" :: held 0.728s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:05 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:05 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Created reservations ['a6be2dd8-171d-4a57-8b71-5ba3f1f3708a', '96f37027-af38-4afb-81e7-2e0dd4af1798', 'f6b2afab-850f-478b-b1c6-3e8cc1fc0a24', '09fc6b35-8513-48c7-8053-e12db489ff1d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:05 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:05 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:05 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Deleted volume successfully. Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ffe9eab3-369a-4a0e-9f46-c7907d919157 tempest-VolumeSnapshotQuotasNegativeTestJSON-598740019 None] Lock "cinder-3a052913-9bd1-4f74-92ca-3ed33fdebc88-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-fd803fb6-fec3-4fc0-bb07-d87aa86524fe-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Lock "cinder-fd803fb6-fec3-4fc0-bb07-d87aa86524fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Acquiring lock "cinder-quobyte-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1954f4-8e74-4349-8cc9-713311d43a9c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:05 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.434s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:05 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-339956ba-6824-4b0a-b831-665ead8759f0 tempest-VolumesGetTest-2027710627 None] Lock "cinder-89cf0740-03e2-4e18-8c19-1008b4ac0f7b-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:06 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe Sep 12 07:25:06 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:06 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" returned: 0 in 0.414s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:06 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe Sep 12 07:25:06 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:06 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" returned: 0 in 0.274s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Lock "cinder-quobyte-fd803fb6-fec3-4fc0-bb07-d87aa86524fe" released by "delete_volume" :: held 0.740s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Created reservations ['9e7be272-86a6-4ecc-86ce-fe5fe1c05ab9', 'b638cb40-27bf-407d-ac2a-582e7b2b792c', '63eddd3e-8e2c-4fe1-8a55-0d94a9492bd6', 'f2179c90-1497-4efa-94b3-3eebaee4256a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:06 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:06 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:07 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.274s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:07 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Deleted volume successfully. Sep 12 07:25:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e4b25a03-87c3-4954-b515-ed175e23b285 tempest-VolumesGetTest-2027710627 None] Lock "cinder-fd803fb6-fec3-4fc0-bb07-d87aa86524fe-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (cc811c67-eb2c-4894-ad32-e050c3d8be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3f9a1-8f23-4592-8ede-001806345554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3f9a1-8f23-4592-8ede-001806345554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092808254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17631ac1-26df-4424-9b8d-a0a4322c97b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:08Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3110ac38-f9df-4a73-b7cd-49a680a98783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3110ac38-f9df-4a73-b7cd-49a680a98783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0612d2fd-668d-40dd-8bbc-f236843035da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0612d2fd-668d-40dd-8bbc-f236843035da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17631ac1-26df-4424-9b8d-a0a4322c97b5', 'volume_name': 'volume-17631ac1-26df-4424-9b8d-a0a4322c97b5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e488467a-4a53-4a94-ab65-d4f3efe01e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e488467a-4a53-4a94-ab65-d4f3efe01e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304c8757-5301-46de-a7de-1d365247e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Volume 17631ac1-26df-4424-9b8d-a0a4322c97b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17631ac1-26df-4424-9b8d-a0a4322c97b5', 'volume_size': 1} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092808254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17631ac1-26df-4424-9b8d-a0a4322c97b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:08Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Creating volume 17631ac1-26df-4424-9b8d-a0a4322c97b5 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:08 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:08 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 1073741824 Sep 12 07:25:08 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:09 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 1073741824" returned: 0 in 0.515s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:09 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 Sep 12 07:25:09 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:09 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304c8757-5301-46de-a7de-1d365247e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17631ac1-26df-4424-9b8d-a0a4322c97b5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b368c353-22e9-4d6a-a693-99a6a1e80f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Volume volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 (17631ac1-26df-4424-9b8d-a0a4322c97b5): created successfully Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b368c353-22e9-4d6a-a693-99a6a1e80f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (cc811c67-eb2c-4894-ad32-e050c3d8be0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c414f293-9dcf-4d74-ab2e-078f34de2da2 tempest-ProjectReaderTests-2082598283 None] Created volume successfully. Sep 12 07:25:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-17631ac1-26df-4424-9b8d-a0a4322c97b5-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Lock "cinder-17631ac1-26df-4424-9b8d-a0a4322c97b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-quobyte-17631ac1-26df-4424-9b8d-a0a4322c97b5" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-17631ac1-26df-4424-9b8d-a0a4322c97b5" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:10 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f05449-226b-4510-b0dd-6b1d37fe6a3a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:11 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 Sep 12 07:25:11 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:11 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5" returned: 0 in 0.390s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:11 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5 Sep 12 07:25:11 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:11 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17631ac1-26df-4424-9b8d-a0a4322c97b5" returned: 0 in 0.297s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-17631ac1-26df-4424-9b8d-a0a4322c97b5" released by "delete_volume" :: held 0.747s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Flow 'volume_create_manager' (ed39e350-1fbc-4d9c-8ca4-2d68868abadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293e6c29-6b25-43fa-97b2-3301a4ed6e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293e6c29-6b25-43fa-97b2-3301a4ed6e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-511453117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f4404b-8446-4109-b147-f353c833894a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90acbab024ff4f68a503464918ed73a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:12Z,use_quota=True,user_id='933081da02454697a221f404d19028ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aee38ec-d71f-4066-8fd4-dc3ac266cfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aee38ec-d71f-4066-8fd4-dc3ac266cfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82fe4b0-3012-4eec-87bd-ba3f0d510fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82fe4b0-3012-4eec-87bd-ba3f0d510fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f4404b-8446-4109-b147-f353c833894a', 'volume_name': 'volume-12f4404b-8446-4109-b147-f353c833894a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c913a8-a814-4301-b36b-9b1fcb24d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c913a8-a814-4301-b36b-9b1fcb24d62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baca568-c7c0-41e2-882e-53d308364ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:11 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Volume 12f4404b-8446-4109-b147-f353c833894a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f4404b-8446-4109-b147-f353c833894a', 'volume_size': 1} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-511453117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f4404b-8446-4109-b147-f353c833894a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90acbab024ff4f68a503464918ed73a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:12Z,use_quota=True,user_id='933081da02454697a221f404d19028ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Creating volume 12f4404b-8446-4109-b147-f353c833894a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:11 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:11 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a 1073741824 Sep 12 07:25:11 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Created reservations ['382b9e40-4a86-4a84-aa2d-5d36100a3cda', '6892e041-030b-4fb7-84e0-2b1c3ac73527', '5e7d1148-f847-47a4-8b0e-bd1e9c40fc97', '7df01bd9-f8fc-42e2-bf2c-f3f6c518bb67'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:11 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:11 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:12 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.322s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Deleted volume successfully. Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-72291bd9-16a2-471d-80d2-a1afca54276a tempest-ProjectReaderTests-2082598283 None] Lock "cinder-17631ac1-26df-4424-9b8d-a0a4322c97b5-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:12 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a 1073741824" returned: 0 in 0.574s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:12 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a Sep 12 07:25:12 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (dd0ab332-b3ab-4438-b75a-10c940282b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ed38e0-a2ab-475d-8b5a-333fcf0ffb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ed38e0-a2ab-475d-8b5a-333fcf0ffb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713447553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c814e62c-76ae-4538-a6e8-a05fd704ad61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:12Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d60508-9b48-4397-bc97-bc2648d89c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d60508-9b48-4397-bc97-bc2648d89c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a16f0f-f858-4a5b-805e-a02d4704c9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a16f0f-f858-4a5b-805e-a02d4704c9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c814e62c-76ae-4538-a6e8-a05fd704ad61', 'volume_name': 'volume-c814e62c-76ae-4538-a6e8-a05fd704ad61', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ffef1c-f9e4-4a65-a2a2-bb8485f1225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ffef1c-f9e4-4a65-a2a2-bb8485f1225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6258994-a9f4-4342-819b-60ac58b74316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Volume c814e62c-76ae-4538-a6e8-a05fd704ad61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c814e62c-76ae-4538-a6e8-a05fd704ad61', 'volume_size': 1} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:12 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.104s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713447553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c814e62c-76ae-4538-a6e8-a05fd704ad61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:12Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Creating volume c814e62c-76ae-4538-a6e8-a05fd704ad61 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:12 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baca568-c7c0-41e2-882e-53d308364ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f4404b-8446-4109-b147-f353c833894a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 1073741824 Sep 12 07:25:12 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db134d-8ca6-46bd-a023-11b473a11469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Volume volume-12f4404b-8446-4109-b147-f353c833894a (12f4404b-8446-4109-b147-f353c833894a): created successfully Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db134d-8ca6-46bd-a023-11b473a11469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Flow 'volume_create_manager' (ed39e350-1fbc-4d9c-8ca4-2d68868abadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-22ad7425-b832-4030-8d60-1e624cccae75 tempest-VolumesListTestJSON-1485983422 None] Created volume successfully. Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Flow 'volume_create_manager' (3629cba5-1c7a-4ba1-b347-04bc1ff5c086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facbbf03-fe9e-48b9-92c7-a487d7d91dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facbbf03-fe9e-48b9-92c7-a487d7d91dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-610827926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b386803e-dede-45fa-ad0a-3b96a5168a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1a00bdbf52478cb5200c9e47ac2769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:13Z,use_quota=True,user_id='77e6360efa474b2ebf007e7edff13f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d080e977-8090-42b6-86a2-c652e89a11ad),volume_type_id=d080e977-8090-42b6-86a2-c652e89a11ad)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7a4c42-af0d-4373-ad35-f14e677282a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7a4c42-af0d-4373-ad35-f14e677282a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f3b6ab-e4e1-4211-ac78-96b9fbf94856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f3b6ab-e4e1-4211-ac78-96b9fbf94856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b386803e-dede-45fa-ad0a-3b96a5168a2d', 'volume_name': 'volume-b386803e-dede-45fa-ad0a-3b96a5168a2d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd21cab8-9ce7-4f85-a5b3-b54d07331875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd21cab8-9ce7-4f85-a5b3-b54d07331875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d3e040-c587-42ca-8c32-54540cb017ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:12 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Volume b386803e-dede-45fa-ad0a-3b96a5168a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b386803e-dede-45fa-ad0a-3b96a5168a2d', 'volume_size': 1} Sep 12 07:25:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:13 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 1073741824" returned: 0 in 0.428s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:13 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 Sep 12 07:25:13 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:13 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-610827926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b386803e-dede-45fa-ad0a-3b96a5168a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1a00bdbf52478cb5200c9e47ac2769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:13Z,use_quota=True,user_id='77e6360efa474b2ebf007e7edff13f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d080e977-8090-42b6-86a2-c652e89a11ad),volume_type_id=d080e977-8090-42b6-86a2-c652e89a11ad)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Creating volume b386803e-dede-45fa-ad0a-3b96a5168a2d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:13 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6258994-a9f4-4342-819b-60ac58b74316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c814e62c-76ae-4538-a6e8-a05fd704ad61', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ba4b85-c0cd-4108-b678-b1a60a76fd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:13 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d 1073741824 Sep 12 07:25:13 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:13 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Volume volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 (c814e62c-76ae-4538-a6e8-a05fd704ad61): created successfully Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ba4b85-c0cd-4108-b678-b1a60a76fd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (dd0ab332-b3ab-4438-b75a-10c940282b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4bf41a1b-7fd2-4dde-bae6-9f5a7a46d2da tempest-ProjectReaderTests-2082598283 None] Created volume successfully. Sep 12 07:25:13 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d 1073741824" returned: 0 in 0.448s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:13 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d Sep 12 07:25:13 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:14 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d3e040-c587-42ca-8c32-54540cb017ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b386803e-dede-45fa-ad0a-3b96a5168a2d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28463229-d240-4a2f-907d-d782f4692fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:14 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Volume volume-b386803e-dede-45fa-ad0a-3b96a5168a2d (b386803e-dede-45fa-ad0a-3b96a5168a2d): created successfully Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28463229-d240-4a2f-907d-d782f4692fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Flow 'volume_create_manager' (3629cba5-1c7a-4ba1-b347-04bc1ff5c086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c81d5dd6-a0be-4729-9160-99a6686299e8 tempest-VolumeTypesAccessTest-1438899102 None] Created volume successfully. Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Flow 'volume_create_manager' (cfa46aab-25e4-483c-8dfd-b7fa5ca7699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46690dfe-355d-4388-a0c6-7c3980349794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46690dfe-355d-4388-a0c6-7c3980349794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-387663620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0588b02-169d-45b1-84b1-be1572769dfd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90acbab024ff4f68a503464918ed73a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:14Z,use_quota=True,user_id='933081da02454697a221f404d19028ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73130904-1405-4340-9967-25ea052c22f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73130904-1405-4340-9967-25ea052c22f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99b5672-f45a-4c01-8bbc-8dd32c8b5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99b5672-f45a-4c01-8bbc-8dd32c8b5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0588b02-169d-45b1-84b1-be1572769dfd', 'volume_name': 'volume-d0588b02-169d-45b1-84b1-be1572769dfd', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c315b66a-2d60-412e-b91f-b239ad76e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c315b66a-2d60-412e-b91f-b239ad76e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7762d46-0932-4358-b533-e95e0af54415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:14 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Volume d0588b02-169d-45b1-84b1-be1572769dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0588b02-169d-45b1-84b1-be1572769dfd', 'volume_size': 1} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-387663620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0588b02-169d-45b1-84b1-be1572769dfd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90acbab024ff4f68a503464918ed73a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:14Z,use_quota=True,user_id='933081da02454697a221f404d19028ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Creating volume d0588b02-169d-45b1-84b1-be1572769dfd {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:14 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:14 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd 1073741824 Sep 12 07:25:14 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-c814e62c-76ae-4538-a6e8-a05fd704ad61-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Lock "cinder-c814e62c-76ae-4538-a6e8-a05fd704ad61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-quobyte-c814e62c-76ae-4538-a6e8-a05fd704ad61" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-c814e62c-76ae-4538-a6e8-a05fd704ad61" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1006a50c-a9c5-41f1-b22d-8ad64e16c0ce]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:14 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd 1073741824" returned: 0 in 0.451s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:14 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd Sep 12 07:25:14 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:14 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 Sep 12 07:25:14 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Acquiring lock "cinder-b386803e-dede-45fa-ad0a-3b96a5168a2d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Lock "cinder-b386803e-dede-45fa-ad0a-3b96a5168a2d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:15 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd" returned: 0 in 0.281s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7762d46-0932-4358-b533-e95e0af54415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0588b02-169d-45b1-84b1-be1572769dfd', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0393197e-d0b3-468c-820f-e9a83907c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Acquiring lock "cinder-quobyte-b386803e-dede-45fa-ad0a-3b96a5168a2d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Volume volume-d0588b02-169d-45b1-84b1-be1572769dfd (d0588b02-169d-45b1-84b1-be1572769dfd): created successfully Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0393197e-d0b3-468c-820f-e9a83907c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Flow 'volume_create_manager' (cfa46aab-25e4-483c-8dfd-b7fa5ca7699b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:15 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61" returned: 0 in 0.392s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Lock "cinder-quobyte-b386803e-dede-45fa-ad0a-3b96a5168a2d" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:15 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61 Sep 12 07:25:15 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e51942b8-4be8-4bca-8c86-972966d0cb6e tempest-VolumesListTestJSON-1485983422 None] Created volume successfully. Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08e34c7-b136-48cc-9fb2-7a706f64d0e0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:15 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d Sep 12 07:25:15 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:15 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c814e62c-76ae-4538-a6e8-a05fd704ad61" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-c814e62c-76ae-4538-a6e8-a05fd704ad61" released by "delete_volume" :: held 0.691s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Created reservations ['1821220b-61da-444d-a6c0-ebd4e7d61b79', 'eaecaa46-43de-4c76-b00c-e2d97114207a', 'f59719db-f539-4fbd-8fe5-bbefff37d233', '81a00dd2-b8f9-43f7-b851-9d344d1f699a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:15 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d" returned: 0 in 0.385s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:15 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:15 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:15 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d Sep 12 07:25:15 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:15 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Deleted volume successfully. Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-039050dd-4ec5-436e-bd9e-37fbab8b5fcb tempest-ProjectReaderTests-2082598283 None] Lock "cinder-c814e62c-76ae-4538-a6e8-a05fd704ad61-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:15 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b386803e-dede-45fa-ad0a-3b96a5168a2d" returned: 0 in 0.285s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Lock "cinder-quobyte-b386803e-dede-45fa-ad0a-3b96a5168a2d" released by "delete_volume" :: held 0.714s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:15 devstack cinder-volume[88013]: WARNING cinder.quota [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1623895923 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1623895923, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:25:15 devstack cinder-volume[88013]: WARNING cinder.quota [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1623895923 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1623895923, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:25:15 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Created reservations ['974386c0-9d54-4a6b-9964-f3c7bed3f358', '329f9d32-eb6b-43f0-9f46-f7b5117b8ada', '8f7ebccd-e973-4514-8d6d-5a2a428b4fd9', '3e27de7d-92a5-4db4-9f7f-9f0bdcdefee2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:16 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:16 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:16 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.287s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Deleted volume successfully. Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (6d83bb29-6431-49ab-befe-997a87456e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9570312d-f148-4c0a-9e77-d118a551874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-20c130d3-5b7b-4202-bd70-24b37bf869aa tempest-VolumeTypesAccessTest-1438899102 None] Lock "cinder-b386803e-dede-45fa-ad0a-3b96a5168a2d-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9570312d-f148-4c0a-9e77-d118a551874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145843988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8959505e-f5bd-4b57-bce4-188db6cb0e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:16Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b05e8f-2efc-46d3-99fc-dee66a52afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b05e8f-2efc-46d3-99fc-dee66a52afa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6eb7f3-9cc8-4b0f-b3b7-32469ffabab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6eb7f3-9cc8-4b0f-b3b7-32469ffabab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8959505e-f5bd-4b57-bce4-188db6cb0e3d', 'volume_name': 'volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a367cdc-c571-4269-a7ec-c4814d63e543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a367cdc-c571-4269-a7ec-c4814d63e543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84e5f1e-036a-4722-ae44-e9a36f97cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Volume 8959505e-f5bd-4b57-bce4-188db6cb0e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d', 'volume_size': 1} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145843988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8959505e-f5bd-4b57-bce4-188db6cb0e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:16Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Creating volume 8959505e-f5bd-4b57-bce4-188db6cb0e3d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:16 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:16 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d 1073741824 Sep 12 07:25:16 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:16 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Flow 'volume_create_manager' (47aee078-2dce-4c4b-9e21-b1be9669999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984ed443-6302-47af-a17e-354f69ae5654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d 1073741824" returned: 0 in 0.543s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984ed443-6302-47af-a17e-354f69ae5654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1276889330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dc3777-37d4-4c0d-b98c-1d21b0b4043b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90acbab024ff4f68a503464918ed73a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:17Z,use_quota=True,user_id='933081da02454697a221f404d19028ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9a4ac1-8b28-4aba-b6dc-77588304b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9a4ac1-8b28-4aba-b6dc-77588304b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cec176e-6450-4768-be9a-8372279d2574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cec176e-6450-4768-be9a-8372279d2574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5dc3777-37d4-4c0d-b98c-1d21b0b4043b', 'volume_name': 'volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b572413-98d4-4685-9257-56cce5675347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b572413-98d4-4685-9257-56cce5675347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb7d77a-d949-44f9-b3e1-c3f9c34f9d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Volume d5dc3777-37d4-4c0d-b98c-1d21b0b4043b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b', 'volume_size': 1} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:17 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d Sep 12 07:25:17 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:17 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1276889330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dc3777-37d4-4c0d-b98c-1d21b0b4043b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90acbab024ff4f68a503464918ed73a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:17Z,use_quota=True,user_id='933081da02454697a221f404d19028ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Creating volume d5dc3777-37d4-4c0d-b98c-1d21b0b4043b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:17 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84e5f1e-036a-4722-ae44-e9a36f97cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:17 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b 1073741824 Sep 12 07:25:17 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e72cbb-9b6d-4563-8b1a-427d649ceaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Volume volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d (8959505e-f5bd-4b57-bce4-188db6cb0e3d): created successfully Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e72cbb-9b6d-4563-8b1a-427d649ceaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (6d83bb29-6431-49ab-befe-997a87456e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-52f8549f-6f7c-4fee-a7d7-43b264aecb2c tempest-ProjectReaderTests-2082598283 None] Created volume successfully. Sep 12 07:25:17 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b 1073741824" returned: 0 in 0.431s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:17 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b Sep 12 07:25:17 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:18 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb7d77a-d949-44f9-b3e1-c3f9c34f9d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37abc73-4ece-46ef-8a09-b74df00ca012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Volume volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b (d5dc3777-37d4-4c0d-b98c-1d21b0b4043b): created successfully Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37abc73-4ece-46ef-8a09-b74df00ca012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Flow 'volume_create_manager' (47aee078-2dce-4c4b-9e21-b1be9669999c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-61a677cf-e930-4a8c-874c-6655d0e6d87c tempest-VolumesListTestJSON-1485983422 None] Created volume successfully. Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-8959505e-f5bd-4b57-bce4-188db6cb0e3d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Lock "cinder-8959505e-f5bd-4b57-bce4-188db6cb0e3d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-quobyte-8959505e-f5bd-4b57-bce4-188db6cb0e3d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-8959505e-f5bd-4b57-bce4-188db6cb0e3d" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df377d2-c137-48b0-a37a-8e905fee0d05]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:18 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d Sep 12 07:25:18 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:18 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d" returned: 0 in 0.392s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:18 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d Sep 12 07:25:18 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:19 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8959505e-f5bd-4b57-bce4-188db6cb0e3d" returned: 0 in 0.259s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-8959505e-f5bd-4b57-bce4-188db6cb0e3d" released by "delete_volume" :: held 0.706s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Created reservations ['96c7ede4-cc15-44cf-ab64-b79e982e4d15', 'ae8ba094-ae90-4bdf-93e6-8562119de0a7', '6a4c077c-088a-439a-abba-d52055c299ad', 'bdbfef42-8550-4e18-91c5-75c18cebd5d2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:19 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:19 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:19 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Deleted volume successfully. Sep 12 07:25:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bacf3f49-db0a-4c8c-9b42-4958ad2cadda tempest-ProjectReaderTests-2082598283 None] Lock "cinder-8959505e-f5bd-4b57-bce4-188db6cb0e3d-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (0d852178-b6e9-4894-9cae-4587c2589ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c2913-c841-4bbc-98b7-0efd5c82a1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c2913-c841-4bbc-98b7-0efd5c82a1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271270586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9e884-a0a8-4704-b603-98b7f955e0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:20Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89535dd7-fd57-4ce9-a891-3f2916ae82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89535dd7-fd57-4ce9-a891-3f2916ae82a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1abf33e-65d9-48d8-99eb-8b796ae0776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1abf33e-65d9-48d8-99eb-8b796ae0776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f9e884-a0a8-4704-b603-98b7f955e0b8', 'volume_name': 'volume-34f9e884-a0a8-4704-b603-98b7f955e0b8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d16ab68-6a9d-433c-a5f2-3b9eb905603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d16ab68-6a9d-433c-a5f2-3b9eb905603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c34850-f4c7-42dd-93c8-0fd81e9fd17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:20 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Volume 34f9e884-a0a8-4704-b603-98b7f955e0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f9e884-a0a8-4704-b603-98b7f955e0b8', 'volume_size': 1} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271270586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9e884-a0a8-4704-b603-98b7f955e0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e45e3c8e942048fbe0f0ddb167e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:20Z,use_quota=True,user_id='f3db1f0a0a014c6db9eee06044a1f74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Creating volume 34f9e884-a0a8-4704-b603-98b7f955e0b8 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:20 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:20 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 1073741824 Sep 12 07:25:20 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:20 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 1073741824" returned: 0 in 0.525s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:20 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 Sep 12 07:25:20 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:21 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8" returned: 0 in 0.276s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c34850-f4c7-42dd-93c8-0fd81e9fd17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f9e884-a0a8-4704-b603-98b7f955e0b8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9ceae3-38ef-4b13-99ae-93ed48532772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Volume volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 (34f9e884-a0a8-4704-b603-98b7f955e0b8): created successfully Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9ceae3-38ef-4b13-99ae-93ed48532772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Flow 'volume_create_manager' (0d852178-b6e9-4894-9cae-4587c2589ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-327c621a-336d-4f7c-9593-f8cc86ac22f6 tempest-ProjectReaderTests-2082598283 None] Created volume successfully. Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "cinder-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "cinder-quobyte-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-quobyte-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969df5f-036f-485d-b94e-b821af754800]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-34f9e884-a0a8-4704-b603-98b7f955e0b8-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Lock "cinder-34f9e884-a0a8-4704-b603-98b7f955e0b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:21 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b Sep 12 07:25:21 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "cinder-quobyte-34f9e884-a0a8-4704-b603-98b7f955e0b8" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-34f9e884-a0a8-4704-b603-98b7f955e0b8" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8347530-1d85-4e98-a488-c740f3b6e85b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:21 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 Sep 12 07:25:21 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:21 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b" returned: 0 in 0.445s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:21 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b Sep 12 07:25:21 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:22 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8" returned: 0 in 0.415s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:22 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8 Sep 12 07:25:22 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:22 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b" returned: 0 in 0.284s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-quobyte-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b" released by "delete_volume" :: held 0.777s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Created reservations ['56414c7b-e8a9-4281-ae2e-9a31931782d6', 'b96409be-4795-431d-93dd-3feb4f5524aa', 'adc6985c-b531-4d81-a6f0-b388ee300231', '3ac18af8-a179-4c6b-a76f-b86f932fb8eb'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:22 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-34f9e884-a0a8-4704-b603-98b7f955e0b8" returned: 0 in 0.276s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:22 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:22 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Lock "cinder-quobyte-34f9e884-a0a8-4704-b603-98b7f955e0b8" released by "delete_volume" :: held 0.740s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Created reservations ['f5bf7de6-dfb5-48bb-8c5b-7b95f05fe0a2', 'b2b20f00-98bf-4acc-bbdf-de750a07e9e4', '5db339a4-6129-43a4-bd02-c0bcad3206fd', '69613bd2-885a-441e-9ea2-1770bc07364d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=170,cinder:UPDATE=230,cinder:INSERT=79,cinder:DELETE=13 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:22 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:22 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "cinder-d0588b02-169d-45b1-84b1-be1572769dfd-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:22 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.395s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-d0588b02-169d-45b1-84b1-be1572769dfd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Deleted volume successfully. Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7656cfd7-45c1-465f-8fe9-00a971b3a4a6 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-d5dc3777-37d4-4c0d-b98c-1d21b0b4043b-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "cinder-quobyte-d0588b02-169d-45b1-84b1-be1572769dfd" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-quobyte-d0588b02-169d-45b1-84b1-be1572769dfd" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bab652-4a82-480a-8056-c2b5f855ae95]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:22 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.340s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Deleted volume successfully. Sep 12 07:25:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3a9329ad-cf3a-4be3-b215-a42930d1fc67 tempest-ProjectReaderTests-2082598283 None] Lock "cinder-34f9e884-a0a8-4704-b603-98b7f955e0b8-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:22 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd Sep 12 07:25:22 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:23 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd" returned: 0 in 0.424s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:23 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd Sep 12 07:25:23 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:23 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d0588b02-169d-45b1-84b1-be1572769dfd" returned: 0 in 0.259s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-quobyte-d0588b02-169d-45b1-84b1-be1572769dfd" released by "delete_volume" :: held 0.736s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Created reservations ['533952a3-ae9f-40b2-b251-cf5c777f740f', 'a2a5572a-1998-4ef0-bffe-5e2c216d53fc', '510b67fa-4501-47a9-b53f-85cb219927df', 'b0fc2905-5f43-43a1-affb-e6aa32c80744'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:23 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:23 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:23 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "cinder-12f4404b-8446-4109-b147-f353c833894a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Deleted volume successfully. Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-12f4404b-8446-4109-b147-f353c833894a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d8ff6700-25c4-47e8-9f71-1c0cfa23c6b9 tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-d0588b02-169d-45b1-84b1-be1572769dfd-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "cinder-quobyte-12f4404b-8446-4109-b147-f353c833894a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-quobyte-12f4404b-8446-4109-b147-f353c833894a" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624af4e-390c-4ac0-abb6-eab21fbc92d4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:24 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a Sep 12 07:25:24 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:24 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a" returned: 0 in 0.399s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:24 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a Sep 12 07:25:24 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:24 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12f4404b-8446-4109-b147-f353c833894a" returned: 0 in 0.273s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-quobyte-12f4404b-8446-4109-b147-f353c833894a" released by "delete_volume" :: held 0.732s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Created reservations ['ef7e9190-f47c-4942-aa19-7bfe055cce3f', '9c10131a-4ea4-49bf-bfbc-38073817c943', '9dcd44dc-cb06-4b8a-830c-b8fd89e73007', '268f9814-87ba-4332-808a-7523361225e2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:24 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:24 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:25 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.267s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:25 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Deleted volume successfully. Sep 12 07:25:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cd1f3d25-9656-4cd1-8f84-82a39175bd3f tempest-VolumesListTestJSON-1485983422 None] Lock "cinder-12f4404b-8446-4109-b147-f353c833894a-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:30 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:30 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:30 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.287s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:25:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:25:34 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:DELETE=1,cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=17 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:25:35 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=187,cinder:SELECT=140,cinder:DELETE=21,cinder:INSERT=45 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Flow 'volume_create_manager' (7ae20cc8-c6bb-4707-82d8-609ec52d9f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2e47cc-e70a-48ea-9ab9-e1341de275b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2e47cc-e70a-48ea-9ab9-e1341de275b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-254817206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6272ce8-85de-4813-8f91-64315d251a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94896f41144f4192a920cd579bfdbbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:42Z,use_quota=True,user_id='ad457dd682584d0f8adc50e5c3128fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cb90e4-ee4d-4fea-8cac-2ecff8f566e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cb90e4-ee4d-4fea-8cac-2ecff8f566e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4761b7a7-1b36-4bfd-af42-1b563655956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:41 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4761b7a7-1b36-4bfd-af42-1b563655956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6272ce8-85de-4813-8f91-64315d251a51', 'volume_name': 'volume-b6272ce8-85de-4813-8f91-64315d251a51', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50c2932-6fb1-4359-bc09-fac790b37128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50c2932-6fb1-4359-bc09-fac790b37128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f98161-5560-4bc6-b902-1afe72924fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Volume b6272ce8-85de-4813-8f91-64315d251a51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6272ce8-85de-4813-8f91-64315d251a51', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Trying to clone b6272ce8-85de-4813-8f91-64315d251a51 from image a5243768-15a1-4db8-a379-25d46ec5cd8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:25:42 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Image download 20.69 MB at 20.69 MB/s Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8608056-981b-40e5-a11f-3ab044e54043]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:43 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD Sep 12 07:25:43 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:43 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c is fetched for user ad457dd682584d0f8adc50e5c3128fcc. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[577907f1-7c20-419e-9766-72f2c08c80a6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:43 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD Sep 12 07:25:43 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:43 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-254817206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6272ce8-85de-4813-8f91-64315d251a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94896f41144f4192a920cd579bfdbbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:42Z,use_quota=True,user_id='ad457dd682584d0f8adc50e5c3128fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Creating volume b6272ce8-85de-4813-8f91-64315d251a51 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:43 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:43 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 1073741824 Sep 12 07:25:43 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:44 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 1073741824" returned: 0 in 0.549s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:44 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 Sep 12 07:25:44 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:44 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51" returned: 0 in 0.277s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Attempting download of a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume b6272ce8-85de-4813-8f91-64315d251a51. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be35378-a95a-4d57-b999-215845c1feac]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:45 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk Sep 12 07:25:45 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:45 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk" returned: 0 in 0.363s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:45 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk Sep 12 07:25:45 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:45 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk" returned: 1 in 0.365s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5243768-15a1-4db8-a379-25d46ec5cd8c_o44r1qwk' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:25:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc66e2a-573c-4160-94cd-3145de9aaa5c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:45 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD Sep 12 07:25:45 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:46 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:46 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] a5243768-15a1-4db8-a379-25d46ec5cd8c was qcow2, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:25:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:46 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 Sep 12 07:25:46 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:48 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51" returned: 0 in 2.106s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5243768-15a1-4db8-a379-25d46ec5cd8c_rofnrwywdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:25:48 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Converted 112.00 MB image at 53.15 MB/s Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:48 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 1G Sep 12 07:25:48 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:48 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 1G" returned: 0 in 0.417s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Downloaded image a5243768-15a1-4db8-a379-25d46ec5cd8c ((None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}])) to volume b6272ce8-85de-4813-8f91-64315d251a51 successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Temporary image a5243768-15a1-4db8-a379-25d46ec5cd8c for user ad457dd682584d0f8adc50e5c3128fcc is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Marking volume b6272ce8-85de-4813-8f91-64315d251a51 as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Copying metadata from image a5243768-15a1-4db8-a379-25d46ec5cd8c to b6272ce8-85de-4813-8f91-64315d251a51. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Creating volume glance metadata for volume b6272ce8-85de-4813-8f91-64315d251a51 backed by image a5243768-15a1-4db8-a379-25d46ec5cd8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f98161-5560-4bc6-b902-1afe72924fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6272ce8-85de-4813-8f91-64315d251a51', 'volume_size': 1, 'image_id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5243768-15a1-4db8-a379-25d46ec5cd8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e92de1ba06347b5bb3b65999c1f7494', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5243768-15a1-4db8-a379-25d46ec5cd8c', 'created_at': datetime.datetime(2026, 9, 12, 5, 8, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 8, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5243768-15a1-4db8-a379-25d46ec5cd8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e45cc7-25ae-4670-92b4-e9d793bc24ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Volume volume-b6272ce8-85de-4813-8f91-64315d251a51 (b6272ce8-85de-4813-8f91-64315d251a51): created successfully Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e45cc7-25ae-4670-92b4-e9d793bc24ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Flow 'volume_create_manager' (7ae20cc8-c6bb-4707-82d8-609ec52d9f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a696796c-c5d0-479a-b635-334956e35d11 tempest-VolumesImageMetadata-644233735 None] Created volume successfully. Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Acquiring lock "cinder-b6272ce8-85de-4813-8f91-64315d251a51-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Lock "cinder-b6272ce8-85de-4813-8f91-64315d251a51-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Acquiring lock "cinder-quobyte-b6272ce8-85de-4813-8f91-64315d251a51" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Lock "cinder-quobyte-b6272ce8-85de-4813-8f91-64315d251a51" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[809644a6-26f4-4972-8501-3dee1e3236e5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:50 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 Sep 12 07:25:50 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:50 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51" returned: 0 in 0.418s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:50 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51 Sep 12 07:25:50 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:50 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b6272ce8-85de-4813-8f91-64315d251a51" returned: 0 in 0.320s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Lock "cinder-quobyte-b6272ce8-85de-4813-8f91-64315d251a51" released by "delete_volume" :: held 0.794s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Created reservations ['2b285950-0b61-45ee-b449-81f1a65df95c', '08892a99-b12d-43e1-a31a-31e6700399cd', '8bd73ea3-08b4-4569-80d2-be17e019fdce', '800439a2-5d38-41b2-9cde-a4aa2ee9ceda'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:51 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:25:51 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:51 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.310s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:25:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Deleted volume successfully. Sep 12 07:25:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eba5766f-71e7-4ea2-a544-4f7ef8d45ef3 tempest-VolumesImageMetadata-644233735 None] Lock "cinder-b6272ce8-85de-4813-8f91-64315d251a51-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Flow 'volume_create_manager' (1691a0a6-9a81-4ce4-b5f8-074c4dcf6cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd94f87-543c-4eb7-9a09-e8df3e547473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd94f87-543c-4eb7-9a09-e8df3e547473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1952251469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0759fa01-7c59-4f79-a6c0-60846878b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f673dc460cef4ae3bab6fec45d62ad67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:54Z,use_quota=True,user_id='1630362db03046c6a13c4a4ac2e234df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693838b2-bbd8-478f-91d4-1aeab7e8e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693838b2-bbd8-478f-91d4-1aeab7e8e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f680b6-faa6-48df-a855-fdf897fc5d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f680b6-faa6-48df-a855-fdf897fc5d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0759fa01-7c59-4f79-a6c0-60846878b8ee', 'volume_name': 'volume-0759fa01-7c59-4f79-a6c0-60846878b8ee', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc1971-6bc7-40d9-ac18-e2cf7618dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc1971-6bc7-40d9-ac18-e2cf7618dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c75de8-277c-4b36-9a7d-ad6aba404e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Volume 0759fa01-7c59-4f79-a6c0-60846878b8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0759fa01-7c59-4f79-a6c0-60846878b8ee', 'volume_size': 1} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1952251469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0759fa01-7c59-4f79-a6c0-60846878b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f673dc460cef4ae3bab6fec45d62ad67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:54Z,use_quota=True,user_id='1630362db03046c6a13c4a4ac2e234df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Creating volume 0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:54 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:54 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee 1073741824 Sep 12 07:25:54 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:55 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee 1073741824" returned: 0 in 0.586s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:55 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee Sep 12 07:25:55 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:55 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c75de8-277c-4b36-9a7d-ad6aba404e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0759fa01-7c59-4f79-a6c0-60846878b8ee', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6678688-e6da-45fd-a34e-7e0d0a85e318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:55 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Volume volume-0759fa01-7c59-4f79-a6c0-60846878b8ee (0759fa01-7c59-4f79-a6c0-60846878b8ee): created successfully Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6678688-e6da-45fd-a34e-7e0d0a85e318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Flow 'volume_create_manager' (1691a0a6-9a81-4ce4-b5f8-074c4dcf6cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:55 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-167f2e1c-0a38-4a24-bda9-e0d9d92af1ed tempest-SnapshotDependencyTests-65431877 None] Created volume successfully. Sep 12 07:25:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Creating offline snapshot 86b3dc68-dcd9-4e94-9d33-f0a3262bef67 of volume 0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:25:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0047573-71bc-4465-8658-107f8193a70e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:25:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:56 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee Sep 12 07:25:56 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:57 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:57 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 1G Sep 12 07:25:57 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:57 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 1G" returned: 0 in 0.549s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0759fa01-7c59-4f79-a6c0-60846878b8ee -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:57 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0759fa01-7c59-4f79-a6c0-60846878b8ee -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 Sep 12 07:25:57 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:58 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0759fa01-7c59-4f79-a6c0-60846878b8ee -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67" returned: 0 in 0.337s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:58 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 is being set with open permissions: ugo+rw Sep 12 07:25:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:58 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 Sep 12 07:25:58 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:58 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67" returned: 0 in 0.289s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:58 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info Sep 12 07:25:58 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:58 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info" returned: 0 in 0.276s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:58 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info is being set with open permissions: ugo+rw Sep 12 07:25:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:58 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info Sep 12 07:25:58 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:25:59 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Flow 'volume_create_manager' (f231942c-7ad1-414f-95bb-70d9a23f0d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f53cf1-e6ce-4a96-bb4e-50b7e6998302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.info" returned: 0 in 0.365s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f53cf1-e6ce-4a96-bb4e-50b7e6998302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-208085748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cd6479-fdbe-4717-b7f7-3888c74102c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833ec1ee1fa449a88178b1029cfda59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:59Z,use_quota=True,user_id='ba20fc8861834ff3b5c31de86b159ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8124f203-e002-4218-803f-de7f13dc8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8124f203-e002-4218-803f-de7f13dc8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc902f5-fbc8-4c06-8c0b-8a3933644f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc902f5-fbc8-4c06-8c0b-8a3933644f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79cd6479-fdbe-4717-b7f7-3888c74102c6', 'volume_name': 'volume-79cd6479-fdbe-4717-b7f7-3888c74102c6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2b4ee5-be79-4d20-908e-edf2eb67d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2b4ee5-be79-4d20-908e-edf2eb67d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b345e533-1c24-423d-8d61-5722f1a91f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:25:59 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Volume 79cd6479-fdbe-4717-b7f7-3888c74102c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79cd6479-fdbe-4717-b7f7-3888c74102c6', 'volume_size': 1} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-208085748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cd6479-fdbe-4717-b7f7-3888c74102c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833ec1ee1fa449a88178b1029cfda59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:25:59Z,use_quota=True,user_id='ba20fc8861834ff3b5c31de86b159ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Creating volume 79cd6479-fdbe-4717-b7f7-3888c74102c6 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:25:59 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:59 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 1073741824 Sep 12 07:25:59 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:25:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2e8bc081-2200-4d5c-92ed-c0268f47644a tempest-SnapshotDependencyTests-65431877 None] Create snapshot completed successfully Sep 12 07:25:59 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 1073741824" returned: 0 in 0.468s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:25:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:25:59 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 Sep 12 07:25:59 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:00 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b345e533-1c24-423d-8d61-5722f1a91f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cd6479-fdbe-4717-b7f7-3888c74102c6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d114aab3-71b7-4d3b-a11b-73f9d2e88c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:00 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Volume volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 (79cd6479-fdbe-4717-b7f7-3888c74102c6): created successfully Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d114aab3-71b7-4d3b-a11b-73f9d2e88c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Flow 'volume_create_manager' (f231942c-7ad1-414f-95bb-70d9a23f0d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ac535270-5fb5-4db0-894c-9102ab53c8d3 tempest-VolumesTransfersV357Test-662894737 None] Created volume successfully. Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Flow 'volume_create_manager' (e8afe96a-a9aa-4a95-8f59-ae3ce6993c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a815da-bd66-45ea-8ebf-7209dc274490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a815da-bd66-45ea-8ebf-7209dc274490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f673dc460cef4ae3bab6fec45d62ad67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86b3dc68-dcd9-4e94-9d33-f0a3262bef67,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:01Z,use_quota=True,user_id='1630362db03046c6a13c4a4ac2e234df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031c6307-c07e-4aad-bc39-b2dfcc569390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031c6307-c07e-4aad-bc39-b2dfcc569390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b78dd5-b402-4a16-8a93-b9b3e1ac059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b78dd5-b402-4a16-8a93-b9b3e1ac059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c', 'volume_name': 'volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c', 'volume_size': 1, 'snapshot_id': '86b3dc68-dcd9-4e94-9d33-f0a3262bef67'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74b330d-a927-44cd-a6a5-0a5e9307ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74b330d-a927-44cd-a6a5-0a5e9307ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e3b3cc-be1f-4bee-ba47-3c518f76de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Volume 79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c', 'volume_size': 1, 'snapshot_id': '86b3dc68-dcd9-4e94-9d33-f0a3262bef67'} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-quobyte-86b3dc68-dcd9-4e94-9d33-f0a3262bef67-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-86b3dc68-dcd9-4e94-9d33-f0a3262bef67-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Creating volume 79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c from snapshot 86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-quobyte-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] snapshot: 86b3dc68-dcd9-4e94-9d33-f0a3262bef67, volume: 79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a2da97-7f42-4c1e-8d1d-dd2eb133dbd6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:01 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 Sep 12 07:26:01 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:01 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67" returned: 0 in 0.451s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0759fa01-7c59-4f79-a6c0-60846878b8ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b8e3d8-631d-4759-b944-008f4bbf807b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:01 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee Sep 12 07:26:01 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2c520dbf-53ce-44ee-9343-51716ad421e2 tempest-VolumesTransfersV357Test-1590905603 None] Transfer volume completed successfully. Sep 12 07:26:02 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee" returned: 0 in 0.543s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:02 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c Sep 12 07:26:02 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Acquiring lock "cinder-79cd6479-fdbe-4717-b7f7-3888c74102c6-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-79cd6479-fdbe-4717-b7f7-3888c74102c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Acquiring lock "cinder-quobyte-79cd6479-fdbe-4717-b7f7-3888c74102c6" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-quobyte-79cd6479-fdbe-4717-b7f7-3888c74102c6" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba09c739-6bf9-4721-ba3b-5a303d8a8614]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:03 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 Sep 12 07:26:03 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:03 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6" returned: 0 in 0.864s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:03 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6 Sep 12 07:26:03 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:04 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79cd6479-fdbe-4717-b7f7-3888c74102c6" returned: 0 in 0.648s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-quobyte-79cd6479-fdbe-4717-b7f7-3888c74102c6" released by "delete_volume" :: held 1.671s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:04 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Created reservations ['aa6cd0a2-d354-4e48-bc3f-2827296444a0', 'd9b03e31-502e-455c-8058-d8b4d2109e5a', '791453ba-1f82-4056-9021-360dba0c50f3', 'd0241285-6809-41e4-9168-1434040d2f5c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:05 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:05 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:06 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 1.063s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:06 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Deleted volume successfully. Sep 12 07:26:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e41bb479-a5dc-4505-8a3d-d184fc481f64 tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-79cd6479-fdbe-4717-b7f7-3888c74102c6-delete_volume" released by "delete_volume" :: held 3.757s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:07 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Flow 'volume_create_manager' (382bad1f-ea28-4492-beed-b7cad0d85ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4d34d4-477a-4f6f-840e-6380882c86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4d34d4-477a-4f6f-840e-6380882c86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-128738253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3861e4e7-b091-4f07-ad3a-f9707c0faac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833ec1ee1fa449a88178b1029cfda59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:08Z,use_quota=True,user_id='ba20fc8861834ff3b5c31de86b159ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e463b0fb-1e49-4e17-b818-d850704269ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e463b0fb-1e49-4e17-b818-d850704269ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22afbb0-38ee-4130-a3ad-75da1d0ca694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22afbb0-38ee-4130-a3ad-75da1d0ca694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3861e4e7-b091-4f07-ad3a-f9707c0faac6', 'volume_name': 'volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a326ebb6-6216-48dc-a6e8-ce663bc00abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a326ebb6-6216-48dc-a6e8-ce663bc00abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23a0197-7713-4b0c-882d-56b69162f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Volume 3861e4e7-b091-4f07-ad3a-f9707c0faac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6', 'volume_size': 1} Sep 12 07:26:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:09 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" returned: 0 in 7.683s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:09 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:26:09 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Converted 1024.00 MB image at 133.27 MB/s Sep 12 07:26:09 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c is being set with open permissions: ugo+rw Sep 12 07:26:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:09 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c Sep 12 07:26:09 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:10 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" returned: 0 in 0.278s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" released by "_copy_volume_from_snapshot" :: held 9.068s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-86b3dc68-dcd9-4e94-9d33-f0a3262bef67-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" released by "_create_volume_from_snapshot" :: held 9.157s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.176s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.095s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-128738253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3861e4e7-b091-4f07-ad3a-f9707c0faac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833ec1ee1fa449a88178b1029cfda59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:08Z,use_quota=True,user_id='ba20fc8861834ff3b5c31de86b159ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Creating volume 3861e4e7-b091-4f07-ad3a-f9707c0faac6 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:10 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:10 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 1073741824 Sep 12 07:26:10 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e3b3cc-be1f-4bee-ba47-3c518f76de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c', 'volume_size': 1, 'snapshot_id': '86b3dc68-dcd9-4e94-9d33-f0a3262bef67'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b6a045-2f72-4de0-b974-d5d452361e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Volume volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c (79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c): created successfully Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b6a045-2f72-4de0-b974-d5d452361e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Flow 'volume_create_manager' (e8afe96a-a9aa-4a95-8f59-ae3ce6993c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ae487468-7626-4e24-841b-af7ea648c227 tempest-SnapshotDependencyTests-65431877 None] Created volume successfully. Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Flow 'volume_create_manager' (b466c171-47a9-4ff2-882e-a519e2d44567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322674f8-4578-43cf-bb24-ca8533df9816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322674f8-4578-43cf-bb24-ca8533df9816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1966550215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b9270d-de0f-4674-aea9-b6931529d351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac9228ff766402c8e4dd48a3720e012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:11Z,use_quota=True,user_id='317ec0cec8d145a59d703ea7991c383a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aa12a0-c6f6-4686-9908-680f7000322f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aa12a0-c6f6-4686-9908-680f7000322f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d6f9b3-fba8-45bf-89db-b358a43bcfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d6f9b3-fba8-45bf-89db-b358a43bcfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b9270d-de0f-4674-aea9-b6931529d351', 'volume_name': 'volume-74b9270d-de0f-4674-aea9-b6931529d351', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bf7287-1994-430d-bfeb-bfd654552a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bf7287-1994-430d-bfeb-bfd654552a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586f02b8-3938-4910-82b7-129f485efdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Volume 74b9270d-de0f-4674-aea9-b6931529d351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b9270d-de0f-4674-aea9-b6931529d351', 'volume_size': 1} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:10 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 1073741824" returned: 0 in 0.604s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:10 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 Sep 12 07:26:10 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:11 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1966550215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b9270d-de0f-4674-aea9-b6931529d351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac9228ff766402c8e4dd48a3720e012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:11Z,use_quota=True,user_id='317ec0cec8d145a59d703ea7991c383a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Creating volume 74b9270d-de0f-4674-aea9-b6931529d351 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:11 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:11 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 1073741824 Sep 12 07:26:11 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23a0197-7713-4b0c-882d-56b69162f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdfdcd7-16e0-4e9e-8626-39ee3b0fa71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-86b3dc68-dcd9-4e94-9d33-f0a3262bef67-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:11 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Volume volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 (3861e4e7-b091-4f07-ad3a-f9707c0faac6): created successfully Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdfdcd7-16e0-4e9e-8626-39ee3b0fa71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Flow 'volume_create_manager' (382bad1f-ea28-4492-beed-b7cad0d85ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-86b3dc68-dcd9-4e94-9d33-f0a3262bef67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-quobyte-0759fa01-7c59-4f79-a6c0-60846878b8ee" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1be75eb6-98d0-45e3-b082-0a53b6b557a2 tempest-VolumesTransfersV357Test-662894737 None] Created volume successfully. Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-0759fa01-7c59-4f79-a6c0-60846878b8ee" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-quobyte-86b3dc68-dcd9-4e94-9d33-f0a3262bef67" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-86b3dc68-dcd9-4e94-9d33-f0a3262bef67" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Deleting offline snapshot 86b3dc68-dcd9-4e94-9d33-f0a3262bef67 of volume 0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] snapshot_file for this snap is: volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[149dcd3d-0d0c-411a-aa74-2ec452c3afb7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:11 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 Sep 12 07:26:11 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:11 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 1073741824" returned: 0 in 0.479s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:11 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 Sep 12 07:26:11 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:11 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67" returned: 0 in 0.397s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0759fa01-7c59-4f79-a6c0-60846878b8ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9302d08-7251-4317-bb6e-bdecaaabea1e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:11 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee Sep 12 07:26:11 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:11 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351" returned: 0 in 0.271s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586f02b8-3938-4910-82b7-129f485efdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b9270d-de0f-4674-aea9-b6931529d351', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6a8ef1-15a8-466c-a3c2-eaf408325d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:12 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Volume volume-74b9270d-de0f-4674-aea9-b6931529d351 (74b9270d-de0f-4674-aea9-b6931529d351): created successfully Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6a8ef1-15a8-466c-a3c2-eaf408325d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Flow 'volume_create_manager' (b466c171-47a9-4ff2-882e-a519e2d44567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d0690cdd-7043-45e7-8afc-5cc4f8a10d84 tempest-TestMinimumBasicScenario-221717167 None] Created volume successfully. Sep 12 07:26:12 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee" returned: 0 in 0.561s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:12 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 Sep 12 07:26:12 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Acquiring lock "cinder-3861e4e7-b091-4f07-ad3a-f9707c0faac6-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-3861e4e7-b091-4f07-ad3a-f9707c0faac6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Acquiring lock "cinder-quobyte-3861e4e7-b091-4f07-ad3a-f9707c0faac6" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-quobyte-3861e4e7-b091-4f07-ad3a-f9707c0faac6" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67fa2b9-5caa-4bea-a95d-28e76affe0fa]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:12 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 Sep 12 07:26:12 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:12 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67" returned: 0 in 0.426s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:12 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67 Sep 12 07:26:12 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:13 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6" returned: 0 in 0.470s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:13 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6 Sep 12 07:26:13 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:13 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee.86b3dc68-dcd9-4e94-9d33-f0a3262bef67" returned: 0 in 0.292s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-86b3dc68-dcd9-4e94-9d33-f0a3262bef67" released by "_delete_snapshot" :: held 1.792s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-0759fa01-7c59-4f79-a6c0-60846878b8ee" released by "delete_snapshot" :: held 1.815s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Created reservations ['e1f7674c-472a-4cde-b154-1978bc01d307', 'f33dbae0-365f-4eef-86c1-e7086a7523c1', '7a7b6dd7-9a64-481c-8152-d5774b15f32a', '6847f6de-262a-4447-aae9-7a17be89faa5'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Delete snapshot completed successfully. Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7ce18095-416d-472d-b09f-a24e7aaf4a15 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-86b3dc68-dcd9-4e94-9d33-f0a3262bef67-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:13 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3861e4e7-b091-4f07-ad3a-f9707c0faac6" returned: 0 in 0.334s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-quobyte-3861e4e7-b091-4f07-ad3a-f9707c0faac6" released by "delete_volume" :: held 0.860s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Created reservations ['dd130328-34da-4af2-bc44-944dbc8db262', 'fb7637e5-1f15-4cb5-9e2f-439850825080', 'a65761c2-9a22-419e-ae37-62ea96fadf5d', 'eb109555-6cb8-45ff-a0e7-6e09dccd070f'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-0759fa01-7c59-4f79-a6c0-60846878b8ee-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-0759fa01-7c59-4f79-a6c0-60846878b8ee-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-quobyte-0759fa01-7c59-4f79-a6c0-60846878b8ee" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-0759fa01-7c59-4f79-a6c0-60846878b8ee" acquired by "delete_volume" :: waited 0.050s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:13 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:13 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[693cf258-591d-4fb6-bb61-c606ccfa4e49]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:13 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee Sep 12 07:26:13 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:14 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.404s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Deleted volume successfully. Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9bb9081f-8f60-4694-a3fc-f4cba1f63a7f tempest-VolumesTransfersV357Test-998412044 None] Lock "cinder-3861e4e7-b091-4f07-ad3a-f9707c0faac6-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-a325828e-742d-4109-a153-1d7db8e83ab5 req-f9802623-ec7b-40c6-8e6a-32d8e19fb354 tempest-TestMinimumBasicScenario-221717167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-a325828e-742d-4109-a153-1d7db8e83ab5 req-f9802623-ec7b-40c6-8e6a-32d8e19fb354 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-a325828e-742d-4109-a153-1d7db8e83ab5 req-f9802623-ec7b-40c6-8e6a-32d8e19fb354 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-a325828e-742d-4109-a153-1d7db8e83ab5 req-f9802623-ec7b-40c6-8e6a-32d8e19fb354 tempest-TestMinimumBasicScenario-221717167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-74b9270d-de0f-4674-aea9-b6931529d351', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fba28da7-e8e6-48a3-a650-7d95ca7b4e9b', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:26:14 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee" returned: 0 in 0.577s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:14 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee Sep 12 07:26:14 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-a325828e-742d-4109-a153-1d7db8e83ab5 req-f9802623-ec7b-40c6-8e6a-32d8e19fb354 tempest-TestMinimumBasicScenario-221717167 None] attachment_update completed successfully. Sep 12 07:26:14 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0759fa01-7c59-4f79-a6c0-60846878b8ee" returned: 0 in 0.388s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-0759fa01-7c59-4f79-a6c0-60846878b8ee" released by "delete_volume" :: held 1.081s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Created reservations ['ecd91679-1a46-4e8b-bf15-c4a89868409d', '4c1a9234-9b12-48d3-9170-e9f7c3e833c8', '78496faf-6eed-4dc6-b4f9-f1d85820ecd8', '9fbbd450-e70c-4437-acc6-1a56ab2c2a52'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:14 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:14 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:15 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.298s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:15 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Deleted volume successfully. Sep 12 07:26:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d9ad055c-92ac-49c7-8d77-7961b8df6970 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-0759fa01-7c59-4f79-a6c0-60846878b8ee-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "cinder-quobyte-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" acquired by "delete_volume" :: waited 0.048s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed24ae-b9df-47dc-96f7-a37d1549f1bb]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:16 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c Sep 12 07:26:16 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:16 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" returned: 0 in 0.459s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:16 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c Sep 12 07:26:16 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:16 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-quobyte-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c" released by "delete_volume" :: held 0.893s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Created reservations ['a4a95ba2-86ec-42c5-a60b-8215d5bfbec0', 'ced589c4-6422-48ba-aae3-86baf6ab4be3', 'f15df557-3bb5-441d-8a55-dd77a986b251', 'ee3054a4-5944-49db-9263-12f7ef9c5ad7'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:17 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:17 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:17 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.386s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Deleted volume successfully. Sep 12 07:26:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-05aba3f1-36c4-4e4d-a16d-d8a6c672de12 tempest-SnapshotDependencyTests-65431877 None] Lock "cinder-79a2232c-f98d-4ae9-9d3b-c4d6e3ab313c-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:27 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=62,cinder:UPDATE=63,cinder:INSERT=24,cinder:DELETE=5 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:26:27 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:30 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:30 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:30 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.299s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:26:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (43a51268-6a5d-46f3-a371-0bd13580a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df209d7a-0e02-4b17-b772-8fa55fdbd06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df209d7a-0e02-4b17-b772-8fa55fdbd06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1885158124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db6c54d-0b70-44a4-bfdf-5c1b411b3216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:34Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f630e1-b448-4182-989f-3c17bbcdb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f630e1-b448-4182-989f-3c17bbcdb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163c61a7-5da7-48b7-bbd7-8a63319b0308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163c61a7-5da7-48b7-bbd7-8a63319b0308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db6c54d-0b70-44a4-bfdf-5c1b411b3216', 'volume_name': 'volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf434471-c16c-4d3d-8db5-ba6daa561b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf434471-c16c-4d3d-8db5-ba6daa561b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d24d5a-4e2d-4062-a07a-7220522e9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:34 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Volume 6db6c54d-0b70-44a4-bfdf-5c1b411b3216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216', 'volume_size': 1} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1885158124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db6c54d-0b70-44a4-bfdf-5c1b411b3216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:34Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Creating volume 6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:34 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:34 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 1073741824 Sep 12 07:26:34 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:34 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 1073741824" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:34 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 Sep 12 07:26:34 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:34 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d24d5a-4e2d-4062-a07a-7220522e9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac3c894-65fb-4ff6-ab64-2e2d0b60c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:34 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Volume volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 (6db6c54d-0b70-44a4-bfdf-5c1b411b3216): created successfully Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac3c894-65fb-4ff6-ab64-2e2d0b60c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (43a51268-6a5d-46f3-a371-0bd13580a713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cda46ed9-0d6a-492f-8abe-def3475b08b5 tempest-VolumesSnapshotTestJSON-503573091 None] Created volume successfully. Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Creating offline snapshot 4736f2f6-850f-4457-99cb-606448d265f9 of volume 6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d52468d-56fd-4cd4-b954-d1f8f4f9c2bb]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:35 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 Sep 12 07:26:35 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:35 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" returned: 0 in 0.352s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:35 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 1G Sep 12 07:26:35 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:36 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 1G" returned: 0 in 0.474s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:36 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 Sep 12 07:26:36 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:36 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9" returned: 0 in 0.305s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:36 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 is being set with open permissions: ugo+rw Sep 12 07:26:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:36 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 Sep 12 07:26:36 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:36 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:36 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info Sep 12 07:26:36 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:37 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info" returned: 0 in 0.267s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:37 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info is being set with open permissions: ugo+rw Sep 12 07:26:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:37 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info Sep 12 07:26:37 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:37 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.info" returned: 0 in 0.290s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2c397a2c-6fa1-4e5c-89eb-dd070ac55cfc tempest-VolumesSnapshotTestJSON-503573091 None] Create snapshot completed successfully Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-4736f2f6-850f-4457-99cb-606448d265f9-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-4736f2f6-850f-4457-99cb-606448d265f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-4736f2f6-850f-4457-99cb-606448d265f9" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-4736f2f6-850f-4457-99cb-606448d265f9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Deleting offline snapshot 4736f2f6-850f-4457-99cb-606448d265f9 of volume 6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] snapshot_file for this snap is: volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[871504de-00e5-4f03-a0fa-76677ec9a3a7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:39 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 Sep 12 07:26:39 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:39 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:26:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8153458-ff1a-42fe-86cb-9961d3aef6c0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:39 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 Sep 12 07:26:39 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:39 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:39 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 Sep 12 07:26:39 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:40 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9" returned: 0 in 0.325s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:40 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9 Sep 12 07:26:40 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:40 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216.4736f2f6-850f-4457-99cb-606448d265f9" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-4736f2f6-850f-4457-99cb-606448d265f9" released by "_delete_snapshot" :: held 1.415s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" released by "delete_snapshot" :: held 1.438s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['9ff74b40-4e5f-4a66-8408-4ddf0187fc69', 'a6f516de-a486-4eb2-b805-811eab58314e', '1ae96dcb-76b6-4d60-8d27-cc34f4da803d', '8da14682-d190-45d4-8560-808086ab0a6c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:40 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Delete snapshot completed successfully. Sep 12 07:26:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3e1ad842-10d7-476d-afef-9596af8ea994 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-4736f2f6-850f-4457-99cb-606448d265f9-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (dd827347-26a4-4e56-8564-0549127e4057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59691455-05e1-44ed-a946-ef96dcc56a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59691455-05e1-44ed-a946-ef96dcc56a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1163687279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387535e5-2286-4b46-a4d9-8770edae10f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:41Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607e39a8-59d2-4447-ad08-038a8baabf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607e39a8-59d2-4447-ad08-038a8baabf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfef7a60-3921-4e7c-8415-613ac812a877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfef7a60-3921-4e7c-8415-613ac812a877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387535e5-2286-4b46-a4d9-8770edae10f8', 'volume_name': 'volume-387535e5-2286-4b46-a4d9-8770edae10f8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8529af-9137-4195-b23c-47620197d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8529af-9137-4195-b23c-47620197d061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6495cc81-d4b6-44bf-91a2-515b6359dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:41 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Volume 387535e5-2286-4b46-a4d9-8770edae10f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387535e5-2286-4b46-a4d9-8770edae10f8', 'volume_size': 1} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1163687279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387535e5-2286-4b46-a4d9-8770edae10f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:41Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Creating volume 387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:41 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:26:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:41 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 1073741824 Sep 12 07:26:41 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:42 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 1073741824" returned: 0 in 0.399s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:42 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 Sep 12 07:26:42 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:42 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6495cc81-d4b6-44bf-91a2-515b6359dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387535e5-2286-4b46-a4d9-8770edae10f8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a628f9-cfe1-4dde-9b1a-959c9bc1fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Volume volume-387535e5-2286-4b46-a4d9-8770edae10f8 (387535e5-2286-4b46-a4d9-8770edae10f8): created successfully Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a628f9-cfe1-4dde-9b1a-959c9bc1fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (dd827347-26a4-4e56-8564-0549127e4057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:42 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ec534e2a-047c-4c72-a149-46a8328446be tempest-VolumesSnapshotTestJSON-503573091 None] Created volume successfully. Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Creating offline snapshot ddc9e434-7445-43c8-998f-fbba8bfd598d of volume 387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13381de-b003-457f-8a2d-3d864f6b4ed0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:42 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 Sep 12 07:26:42 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:43 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:43 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d 1G Sep 12 07:26:43 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:43 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d 1G" returned: 0 in 0.369s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387535e5-2286-4b46-a4d9-8770edae10f8 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:43 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387535e5-2286-4b46-a4d9-8770edae10f8 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d Sep 12 07:26:43 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:43 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387535e5-2286-4b46-a4d9-8770edae10f8 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d" returned: 0 in 0.303s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:43 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d is being set with open permissions: ugo+rw Sep 12 07:26:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:43 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d Sep 12 07:26:43 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:44 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:44 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info Sep 12 07:26:44 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:44 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info" returned: 0 in 0.273s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:44 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info is being set with open permissions: ugo+rw Sep 12 07:26:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:44 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info Sep 12 07:26:44 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:44 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.info" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-72351932-ace2-46e5-8434-5756e62ea617 tempest-VolumesSnapshotTestJSON-503573091 None] Create snapshot completed successfully Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (687870b2-6e8f-4e72-a7bc-c08700aa4c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49106e65-0003-42b7-99b5-63389163d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49106e65-0003-42b7-99b5-63389163d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1426717493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ac207d-c75e-451c-aa41-6f194571b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ddc9e434-7445-43c8-998f-fbba8bfd598d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:45Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb404854-5f8c-4c03-bec6-27b52762f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb404854-5f8c-4c03-bec6-27b52762f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66880909-6130-4ba0-afc5-093320a61c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66880909-6130-4ba0-afc5-093320a61c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c8ac207d-c75e-451c-aa41-6f194571b51b', 'volume_name': 'volume-c8ac207d-c75e-451c-aa41-6f194571b51b', 'volume_size': 2, 'snapshot_id': 'ddc9e434-7445-43c8-998f-fbba8bfd598d'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038f6fd6-3654-4b79-b79e-c15b7d930cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038f6fd6-3654-4b79-b79e-c15b7d930cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48acd519-6751-4956-a4bb-22908531e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:45 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Volume c8ac207d-c75e-451c-aa41-6f194571b51b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c8ac207d-c75e-451c-aa41-6f194571b51b', 'volume_size': 2, 'snapshot_id': 'ddc9e434-7445-43c8-998f-fbba8bfd598d'} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-ddc9e434-7445-43c8-998f-fbba8bfd598d-c8ac207d-c75e-451c-aa41-6f194571b51b" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-ddc9e434-7445-43c8-998f-fbba8bfd598d-c8ac207d-c75e-451c-aa41-6f194571b51b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Creating volume c8ac207d-c75e-451c-aa41-6f194571b51b from snapshot ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-c8ac207d-c75e-451c-aa41-6f194571b51b" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-c8ac207d-c75e-451c-aa41-6f194571b51b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] snapshot: ddc9e434-7445-43c8-998f-fbba8bfd598d, volume: c8ac207d-c75e-451c-aa41-6f194571b51b, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5cb2e-e2f6-4326-bf04-cdf5e657731a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:45 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d Sep 12 07:26:45 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:46 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387535e5-2286-4b46-a4d9-8770edae10f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7895c-8609-4483-aa25-9e0b28e4c6af]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:46 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 Sep 12 07:26:46 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:46 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8" returned: 0 in 0.385s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:26:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:46 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b Sep 12 07:26:46 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:51 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b" returned: 0 in 4.785s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:26:51 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Converted 1024.00 MB image at 213.96 MB/s Sep 12 07:26:51 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b is being set with open permissions: ugo+rw Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:51 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b Sep 12 07:26:51 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:51 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b" returned: 0 in 0.230s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-c8ac207d-c75e-451c-aa41-6f194571b51b" released by "_copy_volume_from_snapshot" :: held 5.875s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-ddc9e434-7445-43c8-998f-fbba8bfd598d-c8ac207d-c75e-451c-aa41-6f194571b51b" released by "_create_volume_from_snapshot" :: held 5.939s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.956s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48acd519-6751-4956-a4bb-22908531e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ac207d-c75e-451c-aa41-6f194571b51b', 'volume_size': 2, 'snapshot_id': 'ddc9e434-7445-43c8-998f-fbba8bfd598d'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25112fc2-9717-498f-a19b-31af0cff528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:51 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Volume volume-c8ac207d-c75e-451c-aa41-6f194571b51b (c8ac207d-c75e-451c-aa41-6f194571b51b): created successfully Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25112fc2-9717-498f-a19b-31af0cff528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (687870b2-6e8f-4e72-a7bc-c08700aa4c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b3435216-3607-4b64-8d00-46872acbcc9e tempest-VolumesSnapshotTestJSON-503573091 None] Created volume successfully. Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-c8ac207d-c75e-451c-aa41-6f194571b51b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-c8ac207d-c75e-451c-aa41-6f194571b51b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-c8ac207d-c75e-451c-aa41-6f194571b51b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-c8ac207d-c75e-451c-aa41-6f194571b51b" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2760c4ee-425b-4ea6-920c-023fd535dc2b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:52 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b Sep 12 07:26:52 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:52 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b" returned: 0 in 0.359s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:52 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b Sep 12 07:26:52 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:52 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c8ac207d-c75e-451c-aa41-6f194571b51b" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-c8ac207d-c75e-451c-aa41-6f194571b51b" released by "delete_volume" :: held 0.634s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['2512e1b2-0d3e-43c4-be80-9230016b5893', 'cc065594-b196-45b0-9199-64801822f65d', 'c8958143-d4dd-4403-bc8a-8e8e80133f23', 'a4b5cdbf-8fda-4a63-a5fe-ae7d3a838009'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:53 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:53 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:53 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.232s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:53 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Deleted volume successfully. Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-11481fbb-c5ac-4614-a938-121eb4228413 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-c8ac207d-c75e-451c-aa41-6f194571b51b-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-ddc9e434-7445-43c8-998f-fbba8bfd598d-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-ddc9e434-7445-43c8-998f-fbba8bfd598d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-387535e5-2286-4b46-a4d9-8770edae10f8" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-387535e5-2286-4b46-a4d9-8770edae10f8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-ddc9e434-7445-43c8-998f-fbba8bfd598d" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-ddc9e434-7445-43c8-998f-fbba8bfd598d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Deleting offline snapshot ddc9e434-7445-43c8-998f-fbba8bfd598d of volume 387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] snapshot_file for this snap is: volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5579960-c4be-41c2-a7e5-93d468cc6565]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:53 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d Sep 12 07:26:53 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:53 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d" returned: 0 in 0.352s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387535e5-2286-4b46-a4d9-8770edae10f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4586eb-a7ca-455c-ac4e-f5393c252f56]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:53 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 Sep 12 07:26:53 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:54 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8" returned: 0 in 0.509s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:54 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d Sep 12 07:26:54 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:54 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d" returned: 0 in 0.315s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:54 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d Sep 12 07:26:54 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:54 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8.ddc9e434-7445-43c8-998f-fbba8bfd598d" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-ddc9e434-7445-43c8-998f-fbba8bfd598d" released by "_delete_snapshot" :: held 1.518s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-387535e5-2286-4b46-a4d9-8770edae10f8" released by "delete_snapshot" :: held 1.540s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['fdc3c48e-9c3e-4119-a16c-23cfbb56e9cd', 'b0f456b5-70ba-4a10-8551-754e6023f506', '36be4d3f-2a42-414a-a12b-24dfd6e878ad', '784296c6-9fc5-4959-80a8-2e81e70dd673'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:55 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Delete snapshot completed successfully. Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a64ee78a-ea24-4385-8017-867d03992a42 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-ddc9e434-7445-43c8-998f-fbba8bfd598d-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-387535e5-2286-4b46-a4d9-8770edae10f8-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-387535e5-2286-4b46-a4d9-8770edae10f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-387535e5-2286-4b46-a4d9-8770edae10f8" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-387535e5-2286-4b46-a4d9-8770edae10f8" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f355a-c2a7-4a79-8347-498b8d547e51]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:55 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 Sep 12 07:26:55 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:56 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:56 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8 Sep 12 07:26:56 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:56 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-387535e5-2286-4b46-a4d9-8770edae10f8" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-387535e5-2286-4b46-a4d9-8770edae10f8" released by "delete_volume" :: held 0.642s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['dcbde970-b170-4a20-84e8-979cae5a91b5', 'be2e275b-4b34-438d-8082-96490137ca8b', '7c566e9f-6fac-46ee-99a5-9e6f691a847d', 'd50c82c7-9549-44cb-a3fe-a8e4a90a0a4b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:56 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:26:56 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:56 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:26:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Deleted volume successfully. Sep 12 07:26:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-85427215-641e-4b16-aa1d-caab0496a00a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-387535e5-2286-4b46-a4d9-8770edae10f8-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (e10bb951-5404-46c3-82a8-a86adffe1413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fa7f2a-e341-44e0-a611-2df42e00b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fa7f2a-e341-44e0-a611-2df42e00b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-669666047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992f5996-412b-4e71-a473-dd6f1dec2dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:57Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a10dd7-4ec5-4ca1-94c2-a5a68a1d87fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a10dd7-4ec5-4ca1-94c2-a5a68a1d87fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256e3a2d-681c-4ec9-b776-7d19a673b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256e3a2d-681c-4ec9-b776-7d19a673b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992f5996-412b-4e71-a473-dd6f1dec2dc8', 'volume_name': 'volume-992f5996-412b-4e71-a473-dd6f1dec2dc8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab2719e-75e3-4d48-9dec-dc5297258225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab2719e-75e3-4d48-9dec-dc5297258225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e30e7a-7d4e-4050-b785-0a17fa53c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:57 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Volume 992f5996-412b-4e71-a473-dd6f1dec2dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992f5996-412b-4e71-a473-dd6f1dec2dc8', 'volume_size': 1} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-669666047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992f5996-412b-4e71-a473-dd6f1dec2dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:26:57Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Creating volume 992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:26:57 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:57 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 1073741824 Sep 12 07:26:57 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:57 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 1073741824" returned: 0 in 0.433s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:57 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 Sep 12 07:26:57 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:58 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e30e7a-7d4e-4050-b785-0a17fa53c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992f5996-412b-4e71-a473-dd6f1dec2dc8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabd8b25-5a8b-4008-9230-cdbffda2e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:26:58 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Volume volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 (992f5996-412b-4e71-a473-dd6f1dec2dc8): created successfully Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabd8b25-5a8b-4008-9230-cdbffda2e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (e10bb951-5404-46c3-82a8-a86adffe1413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:26:58 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4741780a-9aa3-4411-934f-fd1e965e9b68 tempest-VolumesSnapshotTestJSON-503573091 None] Created volume successfully. Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Creating offline snapshot dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 of volume 992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f439903-329a-4496-93bf-7dbe961ae44c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:58 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 Sep 12 07:26:58 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:58 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8" returned: 0 in 0.356s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:58 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 1G Sep 12 07:26:58 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:59 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 1G" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:59 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 Sep 12 07:26:59 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:59 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" returned: 0 in 0.277s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:59 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 is being set with open permissions: ugo+rw Sep 12 07:26:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:59 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 Sep 12 07:26:59 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:26:59 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 12 07:26:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:26:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:26:59 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info Sep 12 07:26:59 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:00 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:00 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info is being set with open permissions: ugo+rw Sep 12 07:27:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:00 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info Sep 12 07:27:00 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:00 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.info" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1f8931ef-4d6c-476f-be1f-a086ad56976f tempest-VolumesSnapshotTestJSON-503573091 None] Create snapshot completed successfully Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (93394eb7-102b-45ec-9cfa-92f821bd5c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87965034-cea2-4099-b671-8c4a0a146107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87965034-cea2-4099-b671-8c4a0a146107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1860296815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a3ad64-c010-4270-b46b-ef78108fdd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89398e1ffab54c7e832ec242ef30e516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dfa3e97a-a3c8-4c82-aed4-ef0e01aead43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:27:01Z,use_quota=True,user_id='e8cd16ca2989462b80dc2e4755e1e683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032334cd-d699-4952-ba92-755a482d82f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032334cd-d699-4952-ba92-755a482d82f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b703d0-ea04-4b67-b49e-40682ed49e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b703d0-ea04-4b67-b49e-40682ed49e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6a3ad64-c010-4270-b46b-ef78108fdd1b', 'volume_name': 'volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b', 'volume_size': 1, 'snapshot_id': 'dfa3e97a-a3c8-4c82-aed4-ef0e01aead43'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5297772a-063a-4c83-b502-c4d54092c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5297772a-063a-4c83-b502-c4d54092c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a12854-1cc7-4f72-a8c6-61785c79b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Volume e6a3ad64-c010-4270-b46b-ef78108fdd1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b', 'volume_size': 1, 'snapshot_id': 'dfa3e97a-a3c8-4c82-aed4-ef0e01aead43'} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43-e6a3ad64-c010-4270-b46b-ef78108fdd1b" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43-e6a3ad64-c010-4270-b46b-ef78108fdd1b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Creating volume e6a3ad64-c010-4270-b46b-ef78108fdd1b from snapshot dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-e6a3ad64-c010-4270-b46b-ef78108fdd1b" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-e6a3ad64-c010-4270-b46b-ef78108fdd1b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] snapshot: dfa3e97a-a3c8-4c82-aed4-ef0e01aead43, volume: e6a3ad64-c010-4270-b46b-ef78108fdd1b, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb6110-4413-4756-8146-2fcd823f42fa]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:01 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 Sep 12 07:27:01 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:01 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" returned: 0 in 0.419s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992f5996-412b-4e71-a473-dd6f1dec2dc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d059bb25-b4c5-4f89-8a84-211f32e8e631]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:02 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 Sep 12 07:27:02 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:02 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8" returned: 0 in 0.428s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:27:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:27:02 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:27:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:02 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b Sep 12 07:27:02 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-9cd81d29-dfe0-4349-bbd3-a048999d379c req-ed750b4f-2020-494f-991a-8f21e3bc9cc7 tempest-TestMinimumBasicScenario-221717167 None] Terminate volume connection completed successfully. Sep 12 07:27:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-9cd81d29-dfe0-4349-bbd3-a048999d379c req-ed750b4f-2020-494f-991a-8f21e3bc9cc7 tempest-TestMinimumBasicScenario-221717167 None] Deleting attachment fba28da7-e8e6-48a3-a650-7d95ca7b4e9b. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:27:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Acquiring lock "cinder-74b9270d-de0f-4674-aea9-b6931529d351-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Lock "cinder-74b9270d-de0f-4674-aea9-b6931529d351-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Acquiring lock "cinder-quobyte-74b9270d-de0f-4674-aea9-b6931529d351" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Lock "cinder-quobyte-74b9270d-de0f-4674-aea9-b6931529d351" acquired by "delete_volume" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:03 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c27ab9-7fa2-4dec-8afa-c09f822d9fb2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:04 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 Sep 12 07:27:04 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:04 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351" returned: 0 in 0.662s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:04 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351 Sep 12 07:27:04 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:05 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-74b9270d-de0f-4674-aea9-b6931529d351" returned: 0 in 0.412s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Lock "cinder-quobyte-74b9270d-de0f-4674-aea9-b6931529d351" released by "delete_volume" :: held 1.147s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Created reservations ['b7563450-d7c1-4e51-a38a-b3872915e55a', 'c72a83b5-a9c9-4599-925b-5fbfeb360a70', '150e3351-4256-4211-bf9c-07526b9b4c78', '125649d0-fbb6-44da-b855-8bca9f77bed1'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:05 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:27:05 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:05 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.661s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:05 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:27:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Deleted volume successfully. Sep 12 07:27:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bd98755a-87e2-4395-a1b3-6611991e68d3 tempest-TestMinimumBasicScenario-221717167 None] Lock "cinder-74b9270d-de0f-4674-aea9-b6931529d351-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:07 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b" returned: 0 in 4.977s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:27:07 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Converted 1024.00 MB image at 205.69 MB/s Sep 12 07:27:07 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b is being set with open permissions: ugo+rw Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:07 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b Sep 12 07:27:07 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:07 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-e6a3ad64-c010-4270-b46b-ef78108fdd1b" released by "_copy_volume_from_snapshot" :: held 6.169s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43-e6a3ad64-c010-4270-b46b-ef78108fdd1b" released by "_create_volume_from_snapshot" :: held 6.234s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.249s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a12854-1cc7-4f72-a8c6-61785c79b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b', 'volume_size': 1, 'snapshot_id': 'dfa3e97a-a3c8-4c82-aed4-ef0e01aead43'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e3205-6e38-447d-8443-43e332d0df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Volume volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b (e6a3ad64-c010-4270-b46b-ef78108fdd1b): created successfully Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e3205-6e38-447d-8443-43e332d0df7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Flow 'volume_create_manager' (93394eb7-102b-45ec-9cfa-92f821bd5c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:27:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9d254657-6c10-4e4e-8b88-c31c61d4e090 tempest-VolumesSnapshotTestJSON-503573091 None] Created volume successfully. Sep 12 07:27:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-e6a3ad64-c010-4270-b46b-ef78108fdd1b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-e6a3ad64-c010-4270-b46b-ef78108fdd1b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-e6a3ad64-c010-4270-b46b-ef78108fdd1b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-e6a3ad64-c010-4270-b46b-ef78108fdd1b" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5893c5f-e12c-4679-9eef-078eddc0ea43]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:09 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b Sep 12 07:27:09 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:09 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b" returned: 0 in 0.338s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:09 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b Sep 12 07:27:09 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:09 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e6a3ad64-c010-4270-b46b-ef78108fdd1b" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-e6a3ad64-c010-4270-b46b-ef78108fdd1b" released by "delete_volume" :: held 0.639s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['83872e74-3c34-49a1-9999-badebc440e53', '6768c001-8933-4dc0-8f7a-4e16817f544f', '7e49de70-1924-4541-a7ef-27498c6d25b5', 'e27f6595-ff53-4a7d-aef6-afaa94785848'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:09 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:27:09 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:10 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:27:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Deleted volume successfully. Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d416430d-c3c4-48d6-aa2f-efe32f97d808 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-e6a3ad64-c010-4270-b46b-ef78108fdd1b-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-992f5996-412b-4e71-a473-dd6f1dec2dc8" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-992f5996-412b-4e71-a473-dd6f1dec2dc8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Deleting offline snapshot dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 of volume 992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] snapshot_file for this snap is: volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6246c7c-4d98-4448-9289-ec52001e3051]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:10 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 Sep 12 07:27:10 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:10 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992f5996-412b-4e71-a473-dd6f1dec2dc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef51eb3-5a63-4acf-ac8e-f3270c24cd34]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:10 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 Sep 12 07:27:10 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:11 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8" returned: 0 in 0.573s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:11 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 Sep 12 07:27:11 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:11 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" returned: 0 in 0.342s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:11 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43 Sep 12 07:27:11 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:11 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8.dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43" released by "_delete_snapshot" :: held 1.641s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-992f5996-412b-4e71-a473-dd6f1dec2dc8" released by "delete_snapshot" :: held 1.663s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['ec2b79e2-0cc8-43ab-afe5-df7157fcfb30', '4c0fe7c1-50ce-464f-9b7f-e52048dccc10', '48f0a5f3-9a9b-44c5-842c-fa2abe760413', '91ec0f83-34ca-4510-a4c0-ce14b5399f53'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Delete snapshot completed successfully. Sep 12 07:27:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2d1b3600-c235-4353-80bf-5b43e434f033 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-dfa3e97a-a3c8-4c82-aed4-ef0e01aead43-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-992f5996-412b-4e71-a473-dd6f1dec2dc8-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-992f5996-412b-4e71-a473-dd6f1dec2dc8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-992f5996-412b-4e71-a473-dd6f1dec2dc8" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-992f5996-412b-4e71-a473-dd6f1dec2dc8" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6423c-7f48-49d9-a8a5-3e175630626d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:12 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 Sep 12 07:27:12 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:12 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8" returned: 0 in 0.362s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:12 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8 Sep 12 07:27:12 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:13 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-992f5996-412b-4e71-a473-dd6f1dec2dc8" returned: 0 in 0.283s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-992f5996-412b-4e71-a473-dd6f1dec2dc8" released by "delete_volume" :: held 0.710s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['c5a7c5a6-12c0-4e72-a783-d61e7649465c', '84e4b506-9203-4597-a442-3e86f2e01ae6', '001cef6a-6126-452e-818e-bb4a4357b6d7', '4b2ecf45-f599-4584-8f1c-91c4a7fb9ecf'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:13 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:27:13 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:13 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.271s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:27:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Deleted volume successfully. Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cddf60e2-e9eb-484d-ba47-cc046615d790 tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-992f5996-412b-4e71-a473-dd6f1dec2dc8-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-6db6c54d-0b70-44a4-bfdf-5c1b411b3216-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-6db6c54d-0b70-44a4-bfdf-5c1b411b3216-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "cinder-quobyte-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae6e46-e204-46f2-8c5d-9018637b9ba0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:13 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 Sep 12 07:27:13 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:14 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" returned: 0 in 0.408s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:14 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216 Sep 12 07:27:14 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:14 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-quobyte-6db6c54d-0b70-44a4-bfdf-5c1b411b3216" released by "delete_volume" :: held 0.714s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Created reservations ['e2f3e5c3-d003-4102-90fb-d740d6d7aaa6', 'b3c34254-07c4-4ef8-b44c-cc4634db71b9', '7744afb6-fd3f-4398-8c83-b1e084037a67', 'c207283e-8ff2-4196-b86f-91e96faa6775'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:14 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:27:14 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:14 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.277s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:27:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Deleted volume successfully. Sep 12 07:27:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-57f8d9ae-0fa7-4f08-9bbf-c6348b35748a tempest-VolumesSnapshotTestJSON-503573091 None] Lock "cinder-6db6c54d-0b70-44a4-bfdf-5c1b411b3216-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Flow 'volume_create_manager' (db74d74f-2401-4833-a18f-bb7215c76522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ded42e-36e4-4bf4-8c17-00865b95e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ded42e-36e4-4bf4-8c17-00865b95e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-656610912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c70031-49ad-4d22-aca4-f085ce6946a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac2d3f4736e4c338c89124c680e21a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:27:22Z,use_quota=True,user_id='ccdac09420934edebc66e617e7297a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecd30b1-cc65-4930-84fb-5db98284a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecd30b1-cc65-4930-84fb-5db98284a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3d2e40-74e9-41d6-abd1-edd0a960b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3d2e40-74e9-41d6-abd1-edd0a960b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c70031-49ad-4d22-aca4-f085ce6946a9', 'volume_name': 'volume-e5c70031-49ad-4d22-aca4-f085ce6946a9', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e0ceee-95d9-4f2d-a5b4-60930ae8e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e0ceee-95d9-4f2d-a5b4-60930ae8e818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e664603a-d494-448d-a9f4-27b83149d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Volume e5c70031-49ad-4d22-aca4-f085ce6946a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c70031-49ad-4d22-aca4-f085ce6946a9', 'volume_size': 1} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-656610912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c70031-49ad-4d22-aca4-f085ce6946a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac2d3f4736e4c338c89124c680e21a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:27:22Z,use_quota=True,user_id='ccdac09420934edebc66e617e7297a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Creating volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:27:22 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:22 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 1073741824 Sep 12 07:27:22 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:22 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 1073741824" returned: 0 in 0.427s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:23 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 Sep 12 07:27:23 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:23 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e664603a-d494-448d-a9f4-27b83149d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c70031-49ad-4d22-aca4-f085ce6946a9', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cb4c57-4748-41f0-ac58-3d2bb4bd5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Volume volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 (e5c70031-49ad-4d22-aca4-f085ce6946a9): created successfully Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cb4c57-4748-41f0-ac58-3d2bb4bd5f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Flow 'volume_create_manager' (db74d74f-2401-4833-a18f-bb7215c76522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:27:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-333bde9e-34b5-4c9a-9563-6643e21dda32 tempest-VolumesSnapshotListTestJSON-307556727 None] Created volume successfully. Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Creating offline snapshot df0954f2-674b-4c25-8e91-e7ebe6b75c55 of volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09b3fe-ce87-4ac4-b1c3-094a3ecebd56]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:23 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 Sep 12 07:27:23 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:24 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9" returned: 0 in 0.375s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:24 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 1G Sep 12 07:27:24 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:24 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 1G" returned: 0 in 0.399s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:24 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:24 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:24 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.312s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:24 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 is being set with open permissions: ugo+rw Sep 12 07:27:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:24 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:24 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:25 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:25 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info Sep 12 07:27:25 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:25 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:25 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info is being set with open permissions: ugo+rw Sep 12 07:27:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:25 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info Sep 12 07:27:25 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.info" returned: 0 in 0.311s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:25 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-09f29f16-529f-4cd5-9bbe-030ef8800f5a tempest-VolumesSnapshotListTestJSON-307556727 None] Create snapshot completed successfully Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Creating offline snapshot e918eb9f-b2b7-4f2a-b815-56a236c4cb9b of volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c1e29-b82c-41ed-87e9-c9df74ecbc3e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:27 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:27 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:27 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.376s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:27 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b 1G Sep 12 07:27:27 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:27 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b 1G" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:27 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:27 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:28 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.296s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:28 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b is being set with open permissions: ugo+rw Sep 12 07:27:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:28 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:28 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:28 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.294s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:28 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=91,cinder:UPDATE=82,cinder:INSERT=25,cinder:DELETE=10 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:27:28 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=79,cinder:UPDATE=98,cinder:INSERT=21,cinder:DELETE=6 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:27:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.520s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-606d5027-c403-478e-8b35-c84da3e3fa84 tempest-VolumesSnapshotListTestJSON-307556727 None] Create snapshot completed successfully Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Creating offline snapshot 1ca4a640-b9bb-44c3-ba65-e8caf73b6002 of volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d1d637-454b-4d56-b9fd-1250cfcd441b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:29 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:29 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:29 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.356s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:29 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 1G Sep 12 07:27:29 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:30 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 1G" returned: 0 in 0.493s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:30 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 Sep 12 07:27:30 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:30 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:27:30 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:30 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002" returned: 0 in 0.359s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:30 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 is being set with open permissions: ugo+rw Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:30 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 Sep 12 07:27:30 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:30 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.295s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:27:30 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.689s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-921db821-566c-4523-bd0e-a4238f28656d tempest-VolumesSnapshotListTestJSON-307556727 None] Create snapshot completed successfully Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-1ca4a640-b9bb-44c3-ba65-e8caf73b6002-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-1ca4a640-b9bb-44c3-ba65-e8caf73b6002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-1ca4a640-b9bb-44c3-ba65-e8caf73b6002" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-1ca4a640-b9bb-44c3-ba65-e8caf73b6002" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Deleting offline snapshot 1ca4a640-b9bb-44c3-ba65-e8caf73b6002 of volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] snapshot_file for this snap is: volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c32a5fe-fcdf-4c39-8dfb-62dde66bb8f9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:32 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 Sep 12 07:27:32 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:32 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002" returned: 0 in 0.384s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb2070-da74-494b-82c1-9386aedc6dd3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:32 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:32 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:33 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:33 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 Sep 12 07:27:33 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:33 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002" returned: 0 in 0.408s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:33 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002 Sep 12 07:27:33 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:33 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.1ca4a640-b9bb-44c3-ba65-e8caf73b6002" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-1ca4a640-b9bb-44c3-ba65-e8caf73b6002" released by "_delete_snapshot" :: held 1.521s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" released by "delete_snapshot" :: held 1.547s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:33 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Created reservations ['41feb868-06ed-4838-8acb-71ca268daacc', '24f611dd-a756-4bbd-8b46-7a4d51248fde', 'e62756af-3f85-478a-9ac2-1545dc688239', 'ad742e4f-4c8d-4026-ace5-5ee8cfe9e17e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Delete snapshot completed successfully. Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7bec478a-6c4b-418c-ac21-2b37c998db48 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-1ca4a640-b9bb-44c3-ba65-e8caf73b6002-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-e918eb9f-b2b7-4f2a-b815-56a236c4cb9b-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-e918eb9f-b2b7-4f2a-b815-56a236c4cb9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Deleting offline snapshot e918eb9f-b2b7-4f2a-b815-56a236c4cb9b of volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] snapshot_file for this snap is: volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[95362510-d29a-443d-bcae-8fd51486cc77]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:34 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:34 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:34 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b941f-591c-4b4e-b170-e67439e6e7b8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:35 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:35 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:35 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.369s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:35 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:35 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:35 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:35 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b Sep 12 07:27:35 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:36 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e918eb9f-b2b7-4f2a-b815-56a236c4cb9b" released by "_delete_snapshot" :: held 1.514s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" released by "delete_snapshot" :: held 1.538s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Created reservations ['89a9b841-5d6a-48ea-be39-abe86698ac6e', '3d9f01eb-d559-4e81-b9f6-9511ea24c8c2', 'cf59834a-2ab5-419a-8fb5-01e1cfbd6237', 'e4c413fc-8994-4b12-9554-3e52016c751e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Delete snapshot completed successfully. Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8bf8c8-e8fb-4ca0-8d1d-49692d155ca0 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-e918eb9f-b2b7-4f2a-b815-56a236c4cb9b-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-df0954f2-674b-4c25-8e91-e7ebe6b75c55-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-df0954f2-674b-4c25-8e91-e7ebe6b75c55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-df0954f2-674b-4c25-8e91-e7ebe6b75c55" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-df0954f2-674b-4c25-8e91-e7ebe6b75c55" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Deleting offline snapshot df0954f2-674b-4c25-8e91-e7ebe6b75c55 of volume e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] snapshot_file for this snap is: volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f47a1b-10e8-4c9c-8c98-0651999e6d03]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:36 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:36 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:37 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c70031-49ad-4d22-aca4-f085ce6946a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[16914fa6-4268-4557-b0b9-2ff646260a53]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:37 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 Sep 12 07:27:37 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:37 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9" returned: 0 in 0.388s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:37 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:37 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:37 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.358s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:37 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55 Sep 12 07:27:37 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:38 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9.df0954f2-674b-4c25-8e91-e7ebe6b75c55" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-df0954f2-674b-4c25-8e91-e7ebe6b75c55" released by "_delete_snapshot" :: held 1.479s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" released by "delete_snapshot" :: held 1.505s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Created reservations ['53a0c794-b436-4ee2-8bb3-f0787e3a3b4b', 'ce969af7-430b-4d60-bfcd-e46405ab80a4', 'd09f78e7-3c73-4a68-bb65-ec18cae31577', '6876453f-8e5f-4dca-a14d-26e937887116'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:38 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Delete snapshot completed successfully. Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f10dc60d-beaa-44d8-a454-b260525df494 tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-df0954f2-674b-4c25-8e91-e7ebe6b75c55-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-e5c70031-49ad-4d22-aca4-f085ce6946a9-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-e5c70031-49ad-4d22-aca4-f085ce6946a9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:27:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2235a9-a355-4d3a-9db6-304359b9b59f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:39 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 Sep 12 07:27:39 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:39 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9" returned: 0 in 0.361s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:39 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9 Sep 12 07:27:39 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:39 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e5c70031-49ad-4d22-aca4-f085ce6946a9" returned: 0 in 0.267s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-quobyte-e5c70031-49ad-4d22-aca4-f085ce6946a9" released by "delete_volume" :: held 0.698s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Created reservations ['7f802626-c7ad-4c22-b6c5-11f84d18a215', '4310f9e3-4786-49f6-a678-11a749ca5ce5', '2af88838-3ff1-4898-9ba8-908488dccd73', '9166b389-999a-4592-a2b4-9fcc98982fdd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:39 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:27:39 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:40 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.264s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:40 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:27:40 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Deleted volume successfully. Sep 12 07:27:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-da4875a5-2334-43e7-8e27-1fc653a1131e tempest-VolumesSnapshotListTestJSON-307556727 None] Lock "cinder-e5c70031-49ad-4d22-aca4-f085ce6946a9-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Flow 'volume_create_manager' (94e54164-ff7d-43b0-800a-87fd3291b60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75e29e8-8b47-4b08-9f57-2a321a1ea119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75e29e8-8b47-4b08-9f57-2a321a1ea119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1521815049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1aef70-bf81-4922-85e0-4bac62027e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052957aca8a8498f9eff6f0488965a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:27:42Z,use_quota=True,user_id='0d7d78a1a3154f61bf4ee12cd030b073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550c71cc-29e9-43d9-a083-be5fe3474654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550c71cc-29e9-43d9-a083-be5fe3474654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9977e0-71a8-4178-960d-8b10a77d1fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9977e0-71a8-4178-960d-8b10a77d1fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1aef70-bf81-4922-85e0-4bac62027e87', 'volume_name': 'volume-0e1aef70-bf81-4922-85e0-4bac62027e87', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013e9450-4170-4d92-951d-61342d1d6fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013e9450-4170-4d92-951d-61342d1d6fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312d2e47-544c-4888-a86f-d6b1d262e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Volume 0e1aef70-bf81-4922-85e0-4bac62027e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1aef70-bf81-4922-85e0-4bac62027e87', 'volume_size': 1} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1521815049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1aef70-bf81-4922-85e0-4bac62027e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052957aca8a8498f9eff6f0488965a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:27:42Z,use_quota=True,user_id='0d7d78a1a3154f61bf4ee12cd030b073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Creating volume 0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:27:42 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:42 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 1073741824 Sep 12 07:27:42 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:42 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 1073741824" returned: 0 in 0.524s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:42 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 Sep 12 07:27:42 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:42 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87" returned: 0 in 0.258s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312d2e47-544c-4888-a86f-d6b1d262e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1aef70-bf81-4922-85e0-4bac62027e87', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db74489-7321-4cfe-a7bc-ca3ea11bd020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:27:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Volume volume-0e1aef70-bf81-4922-85e0-4bac62027e87 (0e1aef70-bf81-4922-85e0-4bac62027e87): created successfully Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db74489-7321-4cfe-a7bc-ca3ea11bd020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:27:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Flow 'volume_create_manager' (94e54164-ff7d-43b0-800a-87fd3291b60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:27:42 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fe831c21-45cb-4cec-904b-c3d1ffcae005 tempest-TestImageHashVerification-1183949305 None] Created volume successfully. Sep 12 07:27:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:27:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:27:44 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d60412-59a1-4512-a233-4c56d4c8e830]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:45 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 Sep 12 07:27:45 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:45 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87" returned: 0 in 0.378s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[10854188-90cf-464e-ad9f-16468108b55a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:45 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 Sep 12 07:27:45 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:45 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 /opt/stack/data/cinder/conversion/0e1aef70-bf81-4922-85e0-4bac62027e87.temp_image.7f8c8547-39f1-4ec7-b0d2-4f50ce9011e5uz2vhs3r.img {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:45 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 /opt/stack/data/cinder/conversion/0e1aef70-bf81-4922-85e0-4bac62027e87.temp_image.7f8c8547-39f1-4ec7-b0d2-4f50ce9011e5uz2vhs3r.img Sep 12 07:27:45 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:50 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 /opt/stack/data/cinder/conversion/0e1aef70-bf81-4922-85e0-4bac62027e87.temp_image.7f8c8547-39f1-4ec7-b0d2-4f50ce9011e5uz2vhs3r.img" returned: 0 in 4.438s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d941aaa-a4dc-4aeb-b79f-67d70d532e4e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:27:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:27:50 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 Sep 12 07:27:50 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:27:50 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 12 07:27:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87" returned: 0 in 0.619s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:27:50 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/conversion/0e1aef70-bf81-4922-85e0-4bac62027e87.temp_image.7f8c8547-39f1-4ec7-b0d2-4f50ce9011e5uz2vhs3r.img {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:27:50 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Converted 1024.00 MB image at 230.56 MB/s Sep 12 07:27:50 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] 7f8c8547-39f1-4ec7-b0d2-4f50ce9011e5 was raw, no need to convert to raw {{(pid=88013) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 12 07:28:00 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:28:00 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Flow 'volume_create_manager' (3994a4e2-93cb-439e-b123-3eca36fa1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4232966-c7bb-4f38-b2c6-3cbae8c97196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4232966-c7bb-4f38-b2c6-3cbae8c97196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582384097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d71c4-7223-4007-a2a4-b14d5628e143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f38793a9344c2ebace4c8e8074d686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:09Z,use_quota=True,user_id='5de71604641d4ea881e73085d6a1321a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52be9a31-781d-4905-bb34-75a524f1e803),volume_type_id=52be9a31-781d-4905-bb34-75a524f1e803)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193e8cf6-4e01-44a6-9770-e30c8a8796f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193e8cf6-4e01-44a6-9770-e30c8a8796f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cde3cd-4e18-462c-a5d1-597cea8c34a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cde3cd-4e18-462c-a5d1-597cea8c34a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6d71c4-7223-4007-a2a4-b14d5628e143', 'volume_name': 'volume-cf6d71c4-7223-4007-a2a4-b14d5628e143', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebfed3a8-9a94-419a-b379-524da5bd056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebfed3a8-9a94-419a-b379-524da5bd056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22ee46e-76ac-4134-9b8d-39b93e4a1cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume cf6d71c4-7223-4007-a2a4-b14d5628e143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6d71c4-7223-4007-a2a4-b14d5628e143', 'volume_size': 1} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Flow 'volume_create_manager' (c92031cf-ee8e-4864-bb59-4a016836d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3aa16c-aea8-4d4d-82eb-0c5d62671356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3aa16c-aea8-4d4d-82eb-0c5d62671356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1906104661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe827ea-3998-42ed-87f4-7b0493412a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f38793a9344c2ebace4c8e8074d686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:10Z,use_quota=True,user_id='5de71604641d4ea881e73085d6a1321a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(916f248f-5a72-4a34-b540-d4015027791d),volume_type_id=916f248f-5a72-4a34-b540-d4015027791d)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6116d8-f508-4fe2-8424-658072d7e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6116d8-f508-4fe2-8424-658072d7e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68cdf66-2fbe-42f0-ae50-ac47204b0565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68cdf66-2fbe-42f0-ae50-ac47204b0565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe827ea-3998-42ed-87f4-7b0493412a8c', 'volume_name': 'volume-1fe827ea-3998-42ed-87f4-7b0493412a8c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0764cf-31aa-4e0c-b15a-a4486dfa8138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0764cf-31aa-4e0c-b15a-a4486dfa8138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f75f57-a439-49f6-960c-664a5c4feb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume 1fe827ea-3998-42ed-87f4-7b0493412a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe827ea-3998-42ed-87f4-7b0493412a8c', 'volume_size': 1} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Flow 'volume_create_manager' (4ae7725b-7847-481b-807f-857f51722cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa9352d-9bae-4c30-a962-a0c0ba7bb821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa9352d-9bae-4c30-a962-a0c0ba7bb821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1441038292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81de8b4e-cbf9-4425-9861-70286814710c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f38793a9344c2ebace4c8e8074d686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:11Z,use_quota=True,user_id='5de71604641d4ea881e73085d6a1321a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79220643-e7e9-4956-aefd-213e4e61539c),volume_type_id=79220643-e7e9-4956-aefd-213e4e61539c)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96901bd-2037-4f83-b841-120d25d4e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96901bd-2037-4f83-b841-120d25d4e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c983638a-473f-4a81-92dd-95d54eb07387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c983638a-473f-4a81-92dd-95d54eb07387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81de8b4e-cbf9-4425-9861-70286814710c', 'volume_name': 'volume-81de8b4e-cbf9-4425-9861-70286814710c', 'volume_size': 1, 'image_id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc6ab14-50a6-4b83-afc7-6597a22267f5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1646817227', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f38793a9344c2ebace4c8e8074d686', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'created_at': datetime.datetime(2026, 9, 12, 5, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 28, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc6ab14-50a6-4b83-afc7-6597a22267f5/file', 'properties': {}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84069d5-fd2c-4d39-89c3-e4f631a09908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84069d5-fd2c-4d39-89c3-e4f631a09908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9dd202-b136-4b0b-9891-a5b9ecc469f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume 81de8b4e-cbf9-4425-9861-70286814710c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81de8b4e-cbf9-4425-9861-70286814710c', 'volume_size': 1, 'image_id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc6ab14-50a6-4b83-afc7-6597a22267f5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1646817227', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f38793a9344c2ebace4c8e8074d686', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'created_at': datetime.datetime(2026, 9, 12, 5, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 28, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc6ab14-50a6-4b83-afc7-6597a22267f5/file', 'properties': {}}, 'image_service': } Sep 12 07:28:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Trying to clone 81de8b4e-cbf9-4425-9861-70286814710c from image afc6ab14-50a6-4b83-afc7-6597a22267f5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/afc6ab14-50a6-4b83-afc7-6597a22267f5', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.572s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Uploaded volume to glance image-id: 7f8c8547-39f1-4ec7-b0d2-4f50ce9011e5. {{(pid=88013) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582384097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d71c4-7223-4007-a2a4-b14d5628e143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f38793a9344c2ebace4c8e8074d686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:09Z,use_quota=True,user_id='5de71604641d4ea881e73085d6a1321a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52be9a31-781d-4905-bb34-75a524f1e803),volume_type_id=52be9a31-781d-4905-bb34-75a524f1e803)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Creating volume cf6d71c4-7223-4007-a2a4-b14d5628e143 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:28:11 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:28:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:11 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 1073741824 Sep 12 07:28:11 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3ff767ae-fa15-4f09-bdc2-bcefc7349828 tempest-TestImageHashVerification-1183949305 None] Copy volume to image completed successfully. Sep 12 07:28:12 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 1073741824" returned: 0 in 0.506s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:12 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 Sep 12 07:28:12 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Acquiring lock "cinder-0e1aef70-bf81-4922-85e0-4bac62027e87-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Lock "cinder-0e1aef70-bf81-4922-85e0-4bac62027e87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:28:12 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143" returned: 0 in 0.292s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.347s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1906104661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe827ea-3998-42ed-87f4-7b0493412a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f38793a9344c2ebace4c8e8074d686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:10Z,use_quota=True,user_id='5de71604641d4ea881e73085d6a1321a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(916f248f-5a72-4a34-b540-d4015027791d),volume_type_id=916f248f-5a72-4a34-b540-d4015027791d)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Creating volume 1fe827ea-3998-42ed-87f4-7b0493412a8c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:28:12 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Acquiring lock "cinder-quobyte-0e1aef70-bf81-4922-85e0-4bac62027e87" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:28:12 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c 1073741824 Sep 12 07:28:12 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22ee46e-76ac-4134-9b8d-39b93e4a1cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6d71c4-7223-4007-a2a4-b14d5628e143', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9775679-3eb1-424c-8e94-e87e23475748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Lock "cinder-quobyte-0e1aef70-bf81-4922-85e0-4bac62027e87" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:28:12 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 (cf6d71c4-7223-4007-a2a4-b14d5628e143): created successfully Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9775679-3eb1-424c-8e94-e87e23475748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Flow 'volume_create_manager' (3994a4e2-93cb-439e-b123-3eca36fa1906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ef1782-eec6-4304-8f91-12a8c22bd0f4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5ebc4f77-4dd4-4421-995c-b652fbace949 tempest-TestInstancesWithCinderVolumes-1404634573 None] Created volume successfully. Sep 12 07:28:12 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 Sep 12 07:28:12 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:12 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c 1073741824" returned: 0 in 0.466s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:12 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87" returned: 0 in 0.444s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:12 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c Sep 12 07:28:12 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:12 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87 Sep 12 07:28:12 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:13 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c" returned: 0 in 0.271s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:13 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f75f57-a439-49f6-960c-664a5c4feb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe827ea-3998-42ed-87f4-7b0493412a8c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfe6be7-309c-46f2-b8b2-eb650fbafe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0e1aef70-bf81-4922-85e0-4bac62027e87" returned: 0 in 0.281s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Lock "cinder-quobyte-0e1aef70-bf81-4922-85e0-4bac62027e87" released by "delete_volume" :: held 0.779s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:28:13 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume volume-1fe827ea-3998-42ed-87f4-7b0493412a8c (1fe827ea-3998-42ed-87f4-7b0493412a8c): created successfully Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfe6be7-309c-46f2-b8b2-eb650fbafe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Flow 'volume_create_manager' (c92031cf-ee8e-4864-bb59-4a016836d260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e2ee0067-828d-48e9-a37d-ab8a50c31982 tempest-TestInstancesWithCinderVolumes-1404634573 None] Created volume successfully. Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Created reservations ['a3711b49-625e-4b19-bae3-4a207d9be33a', '04cf7226-6d38-4d0f-961f-67df8eed6e2e', '8925f224-ecb7-4c12-8983-c8b3a09151a1', '5f645120-e68f-4078-8ce0-c705ad6b1ea7'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:13 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:28:13 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:13 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:28:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Deleted volume successfully. Sep 12 07:28:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8bfa73d4-4098-46fd-a041-5c477b6d5377 tempest-TestImageHashVerification-1183949305 None] Lock "cinder-0e1aef70-bf81-4922-85e0-4bac62027e87-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:28:14 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD, size 20.69 MB, duration 4.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:28:14 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Image download 20.69 MB at 5.17 MB/s Sep 12 07:28:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[740862d2-0e1f-4fdb-9532-3a46c7ed916e]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:28:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:15 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD Sep 12 07:28:15 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:15 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Temporary image afc6ab14-50a6-4b83-afc7-6597a22267f5 is fetched for user 5de71604641d4ea881e73085d6a1321a. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3428dbb5-723c-420b-8799-c9af7b54f290]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:15 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD Sep 12 07:28:15 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:15 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1441038292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81de8b4e-cbf9-4425-9861-70286814710c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f38793a9344c2ebace4c8e8074d686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:11Z,use_quota=True,user_id='5de71604641d4ea881e73085d6a1321a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79220643-e7e9-4956-aefd-213e4e61539c),volume_type_id=79220643-e7e9-4956-aefd-213e4e61539c)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Creating volume 81de8b4e-cbf9-4425-9861-70286814710c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:28:15 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:28:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:15 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c 1073741824 Sep 12 07:28:15 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:16 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c 1073741824" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:16 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c Sep 12 07:28:16 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:16 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Attempting download of afc6ab14-50a6-4b83-afc7-6597a22267f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/afc6ab14-50a6-4b83-afc7-6597a22267f5', 'metadata': {}}])) to volume 81de8b4e-cbf9-4425-9861-70286814710c. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7449d356-cf62-4562-bba0-7cc1ba072633]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_ {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:16 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_ Sep 12 07:28:16 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:16 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_ {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:17 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_ Sep 12 07:28:17 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:17 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_" returned: 1 in 0.344s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc6ab14-50a6-4b83-afc7-6597a22267f5_n46ftjh_' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ec7a4a-2f95-4a12-99d5-8dbd2ecd291c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:17 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD Sep 12 07:28:17 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:17 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] afc6ab14-50a6-4b83-afc7-6597a22267f5 was qcow2, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:28:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:17 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c Sep 12 07:28:17 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:19 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c" returned: 0 in 1.761s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_afc6ab14-50a6-4b83-afc7-6597a22267f5_x4ggcd7qdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:28:19 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Converted 112.00 MB image at 63.55 MB/s Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:19 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c 1G Sep 12 07:28:19 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:19 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c 1G" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Downloaded image afc6ab14-50a6-4b83-afc7-6597a22267f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/afc6ab14-50a6-4b83-afc7-6597a22267f5', 'metadata': {}}])) to volume 81de8b4e-cbf9-4425-9861-70286814710c successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Temporary image afc6ab14-50a6-4b83-afc7-6597a22267f5 for user 5de71604641d4ea881e73085d6a1321a is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Marking volume 81de8b4e-cbf9-4425-9861-70286814710c as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Copying metadata from image afc6ab14-50a6-4b83-afc7-6597a22267f5 to 81de8b4e-cbf9-4425-9861-70286814710c. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Creating volume glance metadata for volume 81de8b4e-cbf9-4425-9861-70286814710c backed by image afc6ab14-50a6-4b83-afc7-6597a22267f5 with: {'image_id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'image_name': 'tempest-scenario-img--1646817227', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9dd202-b136-4b0b-9891-a5b9ecc469f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81de8b4e-cbf9-4425-9861-70286814710c', 'volume_size': 1, 'image_id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc6ab14-50a6-4b83-afc7-6597a22267f5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1646817227', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f38793a9344c2ebace4c8e8074d686', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afc6ab14-50a6-4b83-afc7-6597a22267f5', 'created_at': datetime.datetime(2026, 9, 12, 5, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 28, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc6ab14-50a6-4b83-afc7-6597a22267f5/file', 'properties': {}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d118e568-dbea-402a-a0f8-8137d1cd7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Volume volume-81de8b4e-cbf9-4425-9861-70286814710c (81de8b4e-cbf9-4425-9861-70286814710c): created successfully Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d118e568-dbea-402a-a0f8-8137d1cd7798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Flow 'volume_create_manager' (4ae7725b-7847-481b-807f-857f51722cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a204029d-9f2c-4ee4-8d5b-22ed016395d0 tempest-TestInstancesWithCinderVolumes-1404634573 None] Created volume successfully. Sep 12 07:28:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-2eeb34c3-1338-4762-916a-7a81d032d0bb req-8280273d-b632-4dab-aacb-faae871a9e50 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-2eeb34c3-1338-4762-916a-7a81d032d0bb req-8280273d-b632-4dab-aacb-faae871a9e50 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-2eeb34c3-1338-4762-916a-7a81d032d0bb req-8280273d-b632-4dab-aacb-faae871a9e50 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-2eeb34c3-1338-4762-916a-7a81d032d0bb req-8280273d-b632-4dab-aacb-faae871a9e50 tempest-TestInstancesWithCinderVolumes-1404634573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-81de8b4e-cbf9-4425-9861-70286814710c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c68e3967-a0a2-407a-a83c-af9d11c92c21', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:28:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-2eeb34c3-1338-4762-916a-7a81d032d0bb req-8280273d-b632-4dab-aacb-faae871a9e50 tempest-TestInstancesWithCinderVolumes-1404634573 None] attachment_update completed successfully. Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:30 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:28:30 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:30 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.477s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:28:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:28:33 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:28:33 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:28:46 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:28:46 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Flow 'volume_create_manager' (e95ac961-178a-425c-a99b-ca5d16ff4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f21bcd4-8076-4b8a-ae5f-2458627c704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f21bcd4-8076-4b8a-ae5f-2458627c704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2029765466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097b2694-a063-4697-8d07-290640c5a15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ff4c3c41b4588b3636bb91fdd58ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:49Z,use_quota=True,user_id='78f6c4a74f38478083ac498295b70d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55446799-5f83-43ea-9a88-9ab5fb2ce1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55446799-5f83-43ea-9a88-9ab5fb2ce1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbeb7517-d416-4245-871d-3353c37a4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbeb7517-d416-4245-871d-3353c37a4ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097b2694-a063-4697-8d07-290640c5a15b', 'volume_name': 'volume-097b2694-a063-4697-8d07-290640c5a15b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a100b2a3-d83d-48dc-b850-6a70af057e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a100b2a3-d83d-48dc-b850-6a70af057e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c885a3-1389-4eed-b5cf-937dd8b4f06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Volume 097b2694-a063-4697-8d07-290640c5a15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097b2694-a063-4697-8d07-290640c5a15b', 'volume_size': 1} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2029765466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097b2694-a063-4697-8d07-290640c5a15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ff4c3c41b4588b3636bb91fdd58ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:28:49Z,use_quota=True,user_id='78f6c4a74f38478083ac498295b70d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Creating volume 097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:28:49 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:28:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:49 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b 1073741824 Sep 12 07:28:49 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:50 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b 1073741824" returned: 0 in 0.473s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:28:50 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b Sep 12 07:28:50 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:28:50 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b" returned: 0 in 0.296s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c885a3-1389-4eed-b5cf-937dd8b4f06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097b2694-a063-4697-8d07-290640c5a15b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fdcb9b-b45b-4039-9f23-e12547edb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:28:50 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Volume volume-097b2694-a063-4697-8d07-290640c5a15b (097b2694-a063-4697-8d07-290640c5a15b): created successfully Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fdcb9b-b45b-4039-9f23-e12547edb399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:28:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Flow 'volume_create_manager' (e95ac961-178a-425c-a99b-ca5d16ff4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:28:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-085dd071-1bc4-4dde-9052-ae14369d31f4 tempest-TestStampPattern-320592358 None] Created volume successfully. Sep 12 07:28:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cb8ce6af-6baf-47f8-874f-ee4e953639df req-8740f3fb-2263-49ef-ac8c-3538ccfcc410 tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cb8ce6af-6baf-47f8-874f-ee4e953639df req-8740f3fb-2263-49ef-ac8c-3538ccfcc410 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-cb8ce6af-6baf-47f8-874f-ee4e953639df req-8740f3fb-2263-49ef-ac8c-3538ccfcc410 tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-cb8ce6af-6baf-47f8-874f-ee4e953639df req-8740f3fb-2263-49ef-ac8c-3538ccfcc410 tempest-TestInstancesWithCinderVolumes-1404634573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-cf6d71c4-7223-4007-a2a4-b14d5628e143', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03ada778-f45a-476a-a472-b7adbd0edfd4', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:28:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-cb8ce6af-6baf-47f8-874f-ee4e953639df req-8740f3fb-2263-49ef-ac8c-3538ccfcc410 tempest-TestInstancesWithCinderVolumes-1404634573 None] attachment_update completed successfully. Sep 12 07:28:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-12287302-1214-4ba6-9a4d-3f3455273038 req-bd5eb6de-3a22-4024-8f15-615c57e6084e tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:28:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-12287302-1214-4ba6-9a4d-3f3455273038 req-bd5eb6de-3a22-4024-8f15-615c57e6084e tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:28:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-12287302-1214-4ba6-9a4d-3f3455273038 req-bd5eb6de-3a22-4024-8f15-615c57e6084e tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:28:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-12287302-1214-4ba6-9a4d-3f3455273038 req-bd5eb6de-3a22-4024-8f15-615c57e6084e tempest-TestInstancesWithCinderVolumes-1404634573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-1fe827ea-3998-42ed-87f4-7b0493412a8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8007205-311e-4081-ab82-6f420724b104', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:28:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-12287302-1214-4ba6-9a4d-3f3455273038 req-bd5eb6de-3a22-4024-8f15-615c57e6084e tempest-TestInstancesWithCinderVolumes-1404634573 None] attachment_update completed successfully. Sep 12 07:29:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-a8f762b9-114f-4952-af9d-80fd4906378d req-d3f38086-6733-4745-b93e-22b64a7dd4a5 tempest-TestInstancesWithCinderVolumes-1404634573 None] Terminate volume connection completed successfully. Sep 12 07:29:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-a8f762b9-114f-4952-af9d-80fd4906378d req-d3f38086-6733-4745-b93e-22b64a7dd4a5 tempest-TestInstancesWithCinderVolumes-1404634573 None] Deleting attachment 03ada778-f45a-476a-a472-b7adbd0edfd4. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "cinder-cf6d71c4-7223-4007-a2a4-b14d5628e143-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-cf6d71c4-7223-4007-a2a4-b14d5628e143-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "cinder-quobyte-cf6d71c4-7223-4007-a2a4-b14d5628e143" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-quobyte-cf6d71c4-7223-4007-a2a4-b14d5628e143" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1913bbc7-201e-48e1-9a5e-dbacaf1e7786]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:03 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 Sep 12 07:29:03 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:03 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:03 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143 Sep 12 07:29:03 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:04 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cf6d71c4-7223-4007-a2a4-b14d5628e143" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-quobyte-cf6d71c4-7223-4007-a2a4-b14d5628e143" released by "delete_volume" :: held 0.700s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:04 devstack cinder-volume[88013]: WARNING cinder.quota [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1105085430-16641993 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1105085430-16641993, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:29:04 devstack cinder-volume[88013]: WARNING cinder.quota [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1105085430-16641993 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1105085430-16641993, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Created reservations ['715315b4-7f9b-46fc-8ba6-27277a8a9ced', '7fd268d2-8a90-4c63-af67-790c5589a5ff', 'ebda80d5-104a-499a-bbdc-74c23564d194', '5024543d-aa50-4712-8a04-320898b22913'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:04 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:29:04 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:04 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.259s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:29:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Deleted volume successfully. Sep 12 07:29:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c7a47d9-481b-425f-b769-0737d1c289db tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-cf6d71c4-7223-4007-a2a4-b14d5628e143-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-8c41335f-bc02-40cf-a81e-2ba944154572 req-c59d259d-68db-4ad1-b0ad-94919ae84f47 tempest-TestInstancesWithCinderVolumes-1404634573 None] Terminate volume connection completed successfully. Sep 12 07:29:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-8c41335f-bc02-40cf-a81e-2ba944154572 req-c59d259d-68db-4ad1-b0ad-94919ae84f47 tempest-TestInstancesWithCinderVolumes-1404634573 None] Deleting attachment b8007205-311e-4081-ab82-6f420724b104. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "cinder-1fe827ea-3998-42ed-87f4-7b0493412a8c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-1fe827ea-3998-42ed-87f4-7b0493412a8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "cinder-quobyte-1fe827ea-3998-42ed-87f4-7b0493412a8c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-quobyte-1fe827ea-3998-42ed-87f4-7b0493412a8c" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d079d-78a3-4770-90eb-8d7ce7099e29]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:07 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c Sep 12 07:29:07 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:07 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c" returned: 0 in 0.380s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:07 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c Sep 12 07:29:07 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:08 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-1fe827ea-3998-42ed-87f4-7b0493412a8c" returned: 0 in 0.267s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-quobyte-1fe827ea-3998-42ed-87f4-7b0493412a8c" released by "delete_volume" :: held 0.704s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:08 devstack cinder-volume[88013]: WARNING cinder.quota [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024403-1278546077 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024403-1278546077, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:29:08 devstack cinder-volume[88013]: WARNING cinder.quota [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024403-1278546077 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024403-1278546077, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Created reservations ['898298e3-e087-4ad5-a7f5-7e31d1bc2e29', '57dda766-8186-4450-a631-b986566351ae', 'f125cd7b-6a52-47c6-a9aa-0bd2b3456e90', '571e3b1d-842c-4c8a-a90e-9a4bafcf7bb2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:08 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:29:08 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:08 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.368s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:29:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Deleted volume successfully. Sep 12 07:29:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1c8be4ac-ecd6-4702-a1a7-9e8048d7e34f tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-1fe827ea-3998-42ed-87f4-7b0493412a8c-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-f5709d8f-bee7-430a-96e3-16067cfd746e req-d899f09b-50d5-4069-ba59-b2203c00bff4 tempest-TestInstancesWithCinderVolumes-1404634573 None] Terminate volume connection completed successfully. Sep 12 07:29:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-f5709d8f-bee7-430a-96e3-16067cfd746e req-d899f09b-50d5-4069-ba59-b2203c00bff4 tempest-TestInstancesWithCinderVolumes-1404634573 None] Deleting attachment c68e3967-a0a2-407a-a83c-af9d11c92c21. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "cinder-81de8b4e-cbf9-4425-9861-70286814710c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-81de8b4e-cbf9-4425-9861-70286814710c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "cinder-quobyte-81de8b4e-cbf9-4425-9861-70286814710c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-quobyte-81de8b4e-cbf9-4425-9861-70286814710c" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8229cfe0-85d7-4c89-9545-9f988e780ba4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:12 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c Sep 12 07:29:12 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:12 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c" returned: 0 in 0.356s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:13 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c Sep 12 07:29:13 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:13 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-81de8b4e-cbf9-4425-9861-70286814710c" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-quobyte-81de8b4e-cbf9-4425-9861-70286814710c" released by "delete_volume" :: held 0.632s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:13 devstack cinder-volume[88013]: WARNING cinder.quota [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1629741368-1438871230 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1629741368-1438871230, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:29:13 devstack cinder-volume[88013]: WARNING cinder.quota [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1629741368-1438871230 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1629741368-1438871230, it is now deprecated. Please use the default quota class for default quota. Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Created reservations ['26dbf1f9-9213-45df-b606-676f6969aa6c', '601eff26-bcb5-47d7-b554-10148ae167be', 'a956cb39-f9a6-4dac-82e3-30b1e8458997', '59c2d79e-17b7-4cee-b04b-a486509ede4b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:13 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:29:13 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:13 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:29:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Deleted volume successfully. Sep 12 07:29:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0d0004ed-79c0-4995-b88c-95141d28e80b tempest-TestInstancesWithCinderVolumes-1404634573 None] Lock "cinder-81de8b4e-cbf9-4425-9861-70286814710c-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-72d75211-0241-48df-95d3-b5eed5667b1b req-25aadd1d-c7ff-4799-b8c7-ca2f508d9c76 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-72d75211-0241-48df-95d3-b5eed5667b1b req-25aadd1d-c7ff-4799-b8c7-ca2f508d9c76 tempest-TestStampPattern-320592358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-72d75211-0241-48df-95d3-b5eed5667b1b req-25aadd1d-c7ff-4799-b8c7-ca2f508d9c76 tempest-TestStampPattern-320592358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-72d75211-0241-48df-95d3-b5eed5667b1b req-25aadd1d-c7ff-4799-b8c7-ca2f508d9c76 tempest-TestStampPattern-320592358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-097b2694-a063-4697-8d07-290640c5a15b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e57ecd0-43f2-4b9b-950b-59c08b50ecde', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:29:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-72d75211-0241-48df-95d3-b5eed5667b1b req-25aadd1d-c7ff-4799-b8c7-ca2f508d9c76 tempest-TestStampPattern-320592358 None] attachment_update completed successfully. Sep 12 07:29:26 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-98d89f93-3a4c-4ca3-9155-f7bc2a7f683b req-8473caa9-74cd-4691-98e6-b657ff4e1722 tempest-TestStampPattern-320592358 None] Terminate volume connection completed successfully. Sep 12 07:29:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-98d89f93-3a4c-4ca3-9155-f7bc2a7f683b req-8473caa9-74cd-4691-98e6-b657ff4e1722 tempest-TestStampPattern-320592358 None] Deleting attachment 0e57ecd0-43f2-4b9b-950b-59c08b50ecde. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Creating offline snapshot ac3002f2-3687-4801-afca-774237d2303d of volume 097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4500cb95-1229-43e6-9441-40f8c716d82b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:27 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b Sep 12 07:29:27 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:27 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:27 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d 1G Sep 12 07:29:27 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:28 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d 1G" returned: 0 in 0.429s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097b2694-a063-4697-8d07-290640c5a15b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:28 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097b2694-a063-4697-8d07-290640c5a15b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d Sep 12 07:29:28 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:28 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097b2694-a063-4697-8d07-290640c5a15b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d" returned: 0 in 0.313s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:28 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d is being set with open permissions: ugo+rw Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:28 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d Sep 12 07:29:28 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:28 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:28 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info Sep 12 07:29:28 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:28 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info" returned: 0 in 0.258s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:28 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info is being set with open permissions: ugo+rw Sep 12 07:29:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:28 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info Sep 12 07:29:28 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:29 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.info" returned: 0 in 0.252s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5e66c8fd-c921-497b-b748-ad73b4b4631e tempest-TestStampPattern-320592358 None] Create snapshot completed successfully Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:30 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:29:30 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:30 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.278s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:29:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Flow 'volume_create_manager' (150e793c-bd1a-47b6-a3e1-06fa67613d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81d235c-f697-4e78-8a49-d8b1ff66aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81d235c-f697-4e78-8a49-d8b1ff66aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-277571374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2ce476-ec35-4830-b629-042f504cdb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291ff4c3c41b4588b3636bb91fdd58ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac3002f2-3687-4801-afca-774237d2303d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:29:36Z,use_quota=True,user_id='78f6c4a74f38478083ac498295b70d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0af395-99e0-4c77-9147-06b4f6082955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0af395-99e0-4c77-9147-06b4f6082955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72950bc2-2759-467a-be09-efb1a2622e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72950bc2-2759-467a-be09-efb1a2622e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec2ce476-ec35-4830-b629-042f504cdb70', 'volume_name': 'volume-ec2ce476-ec35-4830-b629-042f504cdb70', 'volume_size': 1, 'snapshot_id': 'ac3002f2-3687-4801-afca-774237d2303d'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aca0653-a6d7-4502-b8b8-440925440f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aca0653-a6d7-4502-b8b8-440925440f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7902e4ab-6b4d-42f0-bbea-72b22ce54b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:29:36 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Volume ec2ce476-ec35-4830-b629-042f504cdb70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec2ce476-ec35-4830-b629-042f504cdb70', 'volume_size': 1, 'snapshot_id': 'ac3002f2-3687-4801-afca-774237d2303d'} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-quobyte-ac3002f2-3687-4801-afca-774237d2303d-ec2ce476-ec35-4830-b629-042f504cdb70" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ac3002f2-3687-4801-afca-774237d2303d-ec2ce476-ec35-4830-b629-042f504cdb70" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Creating volume ec2ce476-ec35-4830-b629-042f504cdb70 from snapshot ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-quobyte-ec2ce476-ec35-4830-b629-042f504cdb70" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ec2ce476-ec35-4830-b629-042f504cdb70" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] snapshot: ac3002f2-3687-4801-afca-774237d2303d, volume: ec2ce476-ec35-4830-b629-042f504cdb70, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5207e70-9ffa-4083-972d-902e44321610]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:29:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:36 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d Sep 12 07:29:36 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:37 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d" returned: 0 in 0.416s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-097b2694-a063-4697-8d07-290640c5a15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0007d8-24c2-42b1-982c-2185ac197b01]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:37 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b Sep 12 07:29:37 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:37 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b" returned: 0 in 0.397s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:29:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:37 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 Sep 12 07:29:37 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:43 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70" returned: 0 in 6.233s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:43 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:29:43 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Converted 1024.00 MB image at 164.26 MB/s Sep 12 07:29:43 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 is being set with open permissions: ugo+rw Sep 12 07:29:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:29:43 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 Sep 12 07:29:43 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:29:44 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ec2ce476-ec35-4830-b629-042f504cdb70" released by "_copy_volume_from_snapshot" :: held 7.521s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ac3002f2-3687-4801-afca-774237d2303d-ec2ce476-ec35-4830-b629-042f504cdb70" released by "_create_volume_from_snapshot" :: held 7.610s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.628s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7902e4ab-6b4d-42f0-bbea-72b22ce54b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2ce476-ec35-4830-b629-042f504cdb70', 'volume_size': 1, 'snapshot_id': 'ac3002f2-3687-4801-afca-774237d2303d'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c102fb4-d575-424d-8276-ac5937f98238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:29:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Volume volume-ec2ce476-ec35-4830-b629-042f504cdb70 (ec2ce476-ec35-4830-b629-042f504cdb70): created successfully Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c102fb4-d575-424d-8276-ac5937f98238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:29:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Flow 'volume_create_manager' (150e793c-bd1a-47b6-a3e1-06fa67613d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:29:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c104d1e8-322a-4ce5-840a-7ea843918793 tempest-TestStampPattern-320592358 None] Created volume successfully. Sep 12 07:29:54 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=44,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:29:54 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=51,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:30:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ea019849-a209-420e-8e31-6e1a75dccd1d req-1141c0c3-f25c-401f-9bed-17656c82e872 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ea019849-a209-420e-8e31-6e1a75dccd1d req-1141c0c3-f25c-401f-9bed-17656c82e872 tempest-TestStampPattern-320592358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-ea019849-a209-420e-8e31-6e1a75dccd1d req-1141c0c3-f25c-401f-9bed-17656c82e872 tempest-TestStampPattern-320592358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:13 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-ea019849-a209-420e-8e31-6e1a75dccd1d req-1141c0c3-f25c-401f-9bed-17656c82e872 tempest-TestStampPattern-320592358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-ec2ce476-ec35-4830-b629-042f504cdb70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f220bc65-cb6c-4c76-b93c-6628ae0fd13f', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:30:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-ea019849-a209-420e-8e31-6e1a75dccd1d req-1141c0c3-f25c-401f-9bed-17656c82e872 tempest-TestStampPattern-320592358 None] attachment_update completed successfully. Sep 12 07:30:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-32d9b032-86fd-49d0-8653-c53c0dcf5573 req-257b2dc7-b97b-4ebf-a0cf-289715775456 tempest-TestStampPattern-320592358 None] Terminate volume connection completed successfully. Sep 12 07:30:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-32d9b032-86fd-49d0-8653-c53c0dcf5573 req-257b2dc7-b97b-4ebf-a0cf-289715775456 tempest-TestStampPattern-320592358 None] Deleting attachment f220bc65-cb6c-4c76-b93c-6628ae0fd13f. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:30:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-ec2ce476-ec35-4830-b629-042f504cdb70-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Lock "cinder-ec2ce476-ec35-4830-b629-042f504cdb70-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-quobyte-ec2ce476-ec35-4830-b629-042f504cdb70" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ec2ce476-ec35-4830-b629-042f504cdb70" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[de537285-4156-4b79-9543-db7409d39cc4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:19 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 Sep 12 07:30:19 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:20 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70" returned: 0 in 0.374s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:20 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70 Sep 12 07:30:20 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:20 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ec2ce476-ec35-4830-b629-042f504cdb70" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ec2ce476-ec35-4830-b629-042f504cdb70" released by "delete_volume" :: held 0.661s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Created reservations ['278fdc18-84ba-44f7-bf0c-6039ffeeb2b3', '6ba012e8-aeec-43f7-87cc-2163452a8689', '3e42de48-3a82-46ba-9053-e1e4b7104fab', '73dcd27e-9919-41ff-aa4b-4acfaab91873'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:20 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:20 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:20 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Deleted volume successfully. Sep 12 07:30:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2767f969-8ca1-4daa-a007-e2c80b442847 tempest-TestStampPattern-320592358 None] Lock "cinder-ec2ce476-ec35-4830-b629-042f504cdb70-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-ac3002f2-3687-4801-afca-774237d2303d-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Lock "cinder-ac3002f2-3687-4801-afca-774237d2303d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-quobyte-097b2694-a063-4697-8d07-290640c5a15b" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-097b2694-a063-4697-8d07-290640c5a15b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-quobyte-ac3002f2-3687-4801-afca-774237d2303d" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ac3002f2-3687-4801-afca-774237d2303d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Deleting offline snapshot ac3002f2-3687-4801-afca-774237d2303d of volume 097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] snapshot_file for this snap is: volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[75523f36-e312-43c4-817d-9b37a455b446]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:21 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d Sep 12 07:30:21 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:21 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d" returned: 0 in 0.353s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-097b2694-a063-4697-8d07-290640c5a15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f9e751-2b56-4018-8422-b44761b11855]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:21 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b Sep 12 07:30:21 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:22 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b" returned: 0 in 0.518s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:22 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d Sep 12 07:30:22 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:22 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d" returned: 0 in 0.373s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:22 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d Sep 12 07:30:22 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Flow 'volume_create_manager' (95ec1ef9-2065-4233-ba24-cabf8cc0be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218b2aef-8219-4c18-89e2-4d0859b49dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218b2aef-8219-4c18-89e2-4d0859b49dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-215470647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ab5499-d6e9-4921-a712-40b530c06255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd710ab0d9c54a0e936d7de68ab10c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:22Z,use_quota=True,user_id='7028cd5cfbc642c3ba776039dd3b9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff0e9b7-3187-412d-894b-9a02803f6c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff0e9b7-3187-412d-894b-9a02803f6c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f718f2-a7a0-4e81-b54c-af0ff232e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f718f2-a7a0-4e81-b54c-af0ff232e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ab5499-d6e9-4921-a712-40b530c06255', 'volume_name': 'volume-17ab5499-d6e9-4921-a712-40b530c06255', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b8cf9f-ef23-466d-a7dd-71110f201548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b8cf9f-ef23-466d-a7dd-71110f201548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0881e1-c892-49db-9ee3-fbb260cb0d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Volume 17ab5499-d6e9-4921-a712-40b530c06255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ab5499-d6e9-4921-a712-40b530c06255', 'volume_size': 1} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-215470647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ab5499-d6e9-4921-a712-40b530c06255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd710ab0d9c54a0e936d7de68ab10c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:22Z,use_quota=True,user_id='7028cd5cfbc642c3ba776039dd3b9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Creating volume 17ab5499-d6e9-4921-a712-40b530c06255 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:22 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:22 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 1073741824 Sep 12 07:30:22 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:22 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b.ac3002f2-3687-4801-afca-774237d2303d" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-ac3002f2-3687-4801-afca-774237d2303d" released by "_delete_snapshot" :: held 1.584s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-097b2694-a063-4697-8d07-290640c5a15b" released by "delete_snapshot" :: held 1.616s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Created reservations ['bcc617d8-091f-4538-a940-722e48b1681d', '181750b3-648b-4445-b6cd-293b624ff731', '2316e265-8e81-4d2e-9452-6398221e4766', '0976bcf5-a60a-4f50-a20a-1a62aa0464c1'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Delete snapshot completed successfully. Sep 12 07:30:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5fc61e52-e0d6-4bc2-8e6c-327851826cb7 tempest-TestStampPattern-320592358 None] Lock "cinder-ac3002f2-3687-4801-afca-774237d2303d-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:22 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 1073741824" returned: 0 in 0.439s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:23 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 Sep 12 07:30:23 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:23 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0881e1-c892-49db-9ee3-fbb260cb0d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ab5499-d6e9-4921-a712-40b530c06255', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c223eaa-4b08-43e6-8498-e4b8152e74ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Volume volume-17ab5499-d6e9-4921-a712-40b530c06255 (17ab5499-d6e9-4921-a712-40b530c06255): created successfully Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c223eaa-4b08-43e6-8498-e4b8152e74ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Flow 'volume_create_manager' (95ec1ef9-2065-4233-ba24-cabf8cc0be6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f3dda829-34e5-4993-aa6e-7024763a1495 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Created volume successfully. Sep 12 07:30:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-54ac74b1-0873-41e2-bb3f-f964afcbe85f req-e683764b-e383-46b2-88b7-682a73bab71e tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-54ac74b1-0873-41e2-bb3f-f964afcbe85f req-e683764b-e383-46b2-88b7-682a73bab71e tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-54ac74b1-0873-41e2-bb3f-f964afcbe85f req-e683764b-e383-46b2-88b7-682a73bab71e tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:24 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-54ac74b1-0873-41e2-bb3f-f964afcbe85f req-e683764b-e383-46b2-88b7-682a73bab71e tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-17ab5499-d6e9-4921-a712-40b530c06255', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '156b6f84-961b-4b78-a20a-9260f1a3e088', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:30:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-54ac74b1-0873-41e2-bb3f-f964afcbe85f req-e683764b-e383-46b2-88b7-682a73bab71e tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] attachment_update completed successfully. Sep 12 07:30:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-097b2694-a063-4697-8d07-290640c5a15b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Lock "cinder-097b2694-a063-4697-8d07-290640c5a15b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Acquiring lock "cinder-quobyte-097b2694-a063-4697-8d07-290640c5a15b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-097b2694-a063-4697-8d07-290640c5a15b" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a886e810-eac1-4e6b-9246-e615e0d39705]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:27 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b Sep 12 07:30:27 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:27 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b" returned: 0 in 0.367s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:27 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b Sep 12 07:30:27 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-247ea73d-32c5-4201-827a-f02fb1f4af43 req-66aba3e5-6f9c-4142-9c28-1cdcb833251a tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Terminate volume connection completed successfully. Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-247ea73d-32c5-4201-827a-f02fb1f4af43 req-66aba3e5-6f9c-4142-9c28-1cdcb833251a tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Deleting attachment 156b6f84-961b-4b78-a20a-9260f1a3e088. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:30:27 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-097b2694-a063-4697-8d07-290640c5a15b" returned: 0 in 0.273s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Lock "cinder-quobyte-097b2694-a063-4697-8d07-290640c5a15b" released by "delete_volume" :: held 0.723s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Created reservations ['1ccc0c77-6170-4bba-a1c4-8dece492d0b8', 'abee6bb9-8ee9-41c5-b1e2-422ffbe23a2c', '448c6adb-65c9-42c1-94c5-44da1bfee70f', '1bb34f66-8fd9-4038-ac5c-e6fa485517b6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:27 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:27 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:28 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Deleted volume successfully. Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6ccc2060-2a7e-4595-97b9-2e7a16fd4df1 tempest-TestStampPattern-320592358 None] Lock "cinder-097b2694-a063-4697-8d07-290640c5a15b-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Acquiring lock "cinder-17ab5499-d6e9-4921-a712-40b530c06255-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "cinder-17ab5499-d6e9-4921-a712-40b530c06255-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Acquiring lock "cinder-quobyte-17ab5499-d6e9-4921-a712-40b530c06255" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "cinder-quobyte-17ab5499-d6e9-4921-a712-40b530c06255" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba044fa0-c612-4e3d-90e0-8cbc4d1002d3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:28 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 Sep 12 07:30:28 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:29 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:29 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255 Sep 12 07:30:29 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:29 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-17ab5499-d6e9-4921-a712-40b530c06255" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "cinder-quobyte-17ab5499-d6e9-4921-a712-40b530c06255" released by "delete_volume" :: held 0.677s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Created reservations ['9cb0c25d-a3d0-4049-9c25-97b74209b77d', '7e6af781-c901-4613-95c0-c0f592855f9e', 'c8b07650-c42f-4a55-8cff-5f267fbab2f8', '0d75b9b1-19e1-4bda-bb72-c1ad04892c79'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:29 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:29 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:29 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Deleted volume successfully. Sep 12 07:30:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2835abca-08e6-4efb-934e-294ad7982b34 tempest-TestServerVolumeAttachScenarioOldVersion-1694937815 None] Lock "cinder-17ab5499-d6e9-4921-a712-40b530c06255-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:30 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:30 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:30 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.274s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:30:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (843b6434-ea46-4b0c-9d4d-e2dd80ad7bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04c4b54-9f94-4302-a206-ec2a7ff83bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04c4b54-9f94-4302-a206-ec2a7ff83bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988858592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4582ffa9-0f47-4b7b-9605-f67f03edfc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:41Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2a7abb-df6e-409f-9bbd-a4dc05bd8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2a7abb-df6e-409f-9bbd-a4dc05bd8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d2756a-3290-437e-9551-71baff1ba2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d2756a-3290-437e-9551-71baff1ba2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4582ffa9-0f47-4b7b-9605-f67f03edfc1e', 'volume_name': 'volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b552e8-0da2-44d0-8b29-5005d196d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b552e8-0da2-44d0-8b29-5005d196d672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa574ac-4896-4be4-9a72-4872110abf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:40 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume 4582ffa9-0f47-4b7b-9605-f67f03edfc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e', 'volume_size': 1} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988858592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4582ffa9-0f47-4b7b-9605-f67f03edfc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:41Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating volume 4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:40 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:41 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e 1073741824 Sep 12 07:30:41 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:41 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e 1073741824" returned: 0 in 0.400s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:41 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e Sep 12 07:30:41 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:41 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa574ac-4896-4be4-9a72-4872110abf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219650d3-f2e6-429a-9d93-f3c6b977e5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:41 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e (4582ffa9-0f47-4b7b-9605-f67f03edfc1e): created successfully Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219650d3-f2e6-429a-9d93-f3c6b977e5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (843b6434-ea46-4b0c-9d4d-e2dd80ad7bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c93fd016-d133-4dd5-a0a3-64920c88275e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created volume successfully. Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating offline snapshot 8edffb66-bb2e-41ed-aaba-5eeea175ea6a of volume 4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b5d9d-ee50-4e73-bd4f-98dc25968b55]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e Sep 12 07:30:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:42 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" returned: 0 in 0.415s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:42 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a 1G Sep 12 07:30:42 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:43 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a 1G" returned: 0 in 0.433s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:43 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a Sep 12 07:30:43 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:43 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a" returned: 0 in 0.309s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:43 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a is being set with open permissions: ugo+rw Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:43 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a Sep 12 07:30:43 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:43 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:43 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info Sep 12 07:30:43 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:43 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:43 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info is being set with open permissions: ugo+rw Sep 12 07:30:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:43 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info Sep 12 07:30:43 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:44 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.info" returned: 0 in 0.276s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a88127f1-9088-4c16-9f4a-19b51a014b83 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Create snapshot completed successfully Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (4f409c93-3285-448e-8dc4-3c267e9081b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf78504-cb21-4102-a344-04225cc5344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf78504-cb21-4102-a344-04225cc5344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816229852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e71f3a5-6522-4be3-9c71-cd900eed84e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:46Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290b1e83-9321-4cbf-9660-85214d504455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290b1e83-9321-4cbf-9660-85214d504455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d416bd-54a6-42dc-b4cc-7eeabc996ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d416bd-54a6-42dc-b4cc-7eeabc996ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e71f3a5-6522-4be3-9c71-cd900eed84e0', 'volume_name': 'volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91164447-eeec-423f-8bb8-a8a75c511dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91164447-eeec-423f-8bb8-a8a75c511dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec1d7cc-1ef7-484b-b466-abb98f954a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume 7e71f3a5-6522-4be3-9c71-cd900eed84e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0', 'volume_size': 1} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816229852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e71f3a5-6522-4be3-9c71-cd900eed84e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:46Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating volume 7e71f3a5-6522-4be3-9c71-cd900eed84e0 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:46 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:46 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 1073741824 Sep 12 07:30:46 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (6380d329-59f2-4399-a01a-a470c678439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969b73aa-f05d-4d21-8be0-f2efd8e955d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969b73aa-f05d-4d21-8be0-f2efd8e955d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779133534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd6c45-e488-4c9d-aa50-3fef17c29432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:46Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b611fc05-6974-40df-bf3b-b6bfd64922df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b611fc05-6974-40df-bf3b-b6bfd64922df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1914c6a5-b7d2-473f-83bb-1f54b8240f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1914c6a5-b7d2-473f-83bb-1f54b8240f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfd6c45-e488-4c9d-aa50-3fef17c29432', 'volume_name': 'volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e96b532-2c9a-40a3-aa46-8f33962f77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e96b532-2c9a-40a3-aa46-8f33962f77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9ce6ac-0a02-4487-a0a5-700ed2eb82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume bbfd6c45-e488-4c9d-aa50-3fef17c29432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432', 'volume_size': 1} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:46 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 1073741824" returned: 0 in 0.615s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:46 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 Sep 12 07:30:46 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (2c0e03e6-b0f5-4d3c-ad46-26a7b62190de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e18c315-03bb-4c2f-ae39-802a19f565cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e18c315-03bb-4c2f-ae39-802a19f565cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1756588606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eff8bdf-6bfa-4d77-8243-f80acbf2011e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:47Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6578b25a-5fd1-4ff8-9a00-ec16a81da7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6578b25a-5fd1-4ff8-9a00-ec16a81da7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c503e1-998e-4f13-aed2-44db6c58c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c503e1-998e-4f13-aed2-44db6c58c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eff8bdf-6bfa-4d77-8243-f80acbf2011e', 'volume_name': 'volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506c5418-c36c-49ee-84d1-531328cdee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506c5418-c36c-49ee-84d1-531328cdee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b62761b-37b1-4a7a-b9bb-42f697809e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume 7eff8bdf-6bfa-4d77-8243-f80acbf2011e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e', 'volume_size': 1} Sep 12 07:30:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:47 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0" returned: 0 in 0.359s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779133534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd6c45-e488-4c9d-aa50-3fef17c29432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:46Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating volume bbfd6c45-e488-4c9d-aa50-3fef17c29432 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:47 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec1d7cc-1ef7-484b-b466-abb98f954a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 1073741824 Sep 12 07:30:47 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3d48f4-2c22-4dfc-be7f-0b95f457e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 (7e71f3a5-6522-4be3-9c71-cd900eed84e0): created successfully Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3d48f4-2c22-4dfc-be7f-0b95f457e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (4f409c93-3285-448e-8dc4-3c267e9081b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-432762ae-2004-4f7b-927c-4472ffaf0086 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created volume successfully. Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (38b5008f-3aee-4c9c-9315-64fbd3f11105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb69d0-4afe-4439-b4b8-8f8db4ebbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb69d0-4afe-4439-b4b8-8f8db4ebbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526267178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f5e52b-d2a6-47a8-8fa8-b2927a0551b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:47Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653628d2-ae0d-45a7-8909-6cb3ab75c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653628d2-ae0d-45a7-8909-6cb3ab75c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcde8085-bcd8-45d4-956c-7c4b9debfa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcde8085-bcd8-45d4-956c-7c4b9debfa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f5e52b-d2a6-47a8-8fa8-b2927a0551b3', 'volume_name': 'volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c77cac2-2450-4af4-8c11-590ae28f3c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c77cac2-2450-4af4-8c11-590ae28f3c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75be93ae-1196-491c-bc39-19da1ddb251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume 63f5e52b-d2a6-47a8-8fa8-b2927a0551b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3', 'volume_size': 1} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (8fbd480c-92f8-4e34-b5ca-03443c886f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9692c2b3-406a-4f61-a973-8682f5962f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9692c2b3-406a-4f61-a973-8682f5962f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358248941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197b023b-1ffe-4f35-a91f-1dcdd830114f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:48Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f384580-6589-4706-a8ba-1258e8e6312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f384580-6589-4706-a8ba-1258e8e6312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e3678a-d051-453e-84d0-f0ce969e306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e3678a-d051-453e-84d0-f0ce969e306a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197b023b-1ffe-4f35-a91f-1dcdd830114f', 'volume_name': 'volume-197b023b-1ffe-4f35-a91f-1dcdd830114f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbba5d5-7887-49b3-8d43-3153a542bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbba5d5-7887-49b3-8d43-3153a542bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee0980a-bd7c-499a-a37e-f49319e9ee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume 197b023b-1ffe-4f35-a91f-1dcdd830114f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197b023b-1ffe-4f35-a91f-1dcdd830114f', 'volume_size': 1} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 1073741824" returned: 0 in 0.635s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:47 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 Sep 12 07:30:47 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:48 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1756588606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eff8bdf-6bfa-4d77-8243-f80acbf2011e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:47Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating volume 7eff8bdf-6bfa-4d77-8243-f80acbf2011e {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:48 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9ce6ac-0a02-4487-a0a5-700ed2eb82d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:48 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e 1073741824 Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549068d6-9d78-4816-a0a4-a7b1f3fa752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:48 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 (bbfd6c45-e488-4c9d-aa50-3fef17c29432): created successfully Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549068d6-9d78-4816-a0a4-a7b1f3fa752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (6380d329-59f2-4399-a01a-a470c678439e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-eb8ba2d2-c783-435c-a383-74ef591d1b2f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created volume successfully. Sep 12 07:30:48 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e 1073741824" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:48 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e Sep 12 07:30:48 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:48 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526267178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f5e52b-d2a6-47a8-8fa8-b2927a0551b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:47Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating volume 63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:48 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b62761b-37b1-4a7a-b9bb-42f697809e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e00f7ab-c08e-4db0-b016-0405ab6df0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:48 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 1073741824 Sep 12 07:30:48 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e (7eff8bdf-6bfa-4d77-8243-f80acbf2011e): created successfully Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e00f7ab-c08e-4db0-b016-0405ab6df0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (2c0e03e6-b0f5-4d3c-ad46-26a7b62190de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-90438683-c8bd-4502-b4ed-90762d171146 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created volume successfully. Sep 12 07:30:49 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 1073741824" returned: 0 in 0.454s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:49 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 Sep 12 07:30:49 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:49 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3" returned: 0 in 0.296s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358248941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197b023b-1ffe-4f35-a91f-1dcdd830114f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b022e16c41cb4ea7ae2bd5c33d34d911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:30:48Z,use_quota=True,user_id='534fba59ee0c456b88f0e73df3f37595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Creating volume 197b023b-1ffe-4f35-a91f-1dcdd830114f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:30:49 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:49 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f 1073741824 Sep 12 07:30:49 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75be93ae-1196-491c-bc39-19da1ddb251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d237e2cc-3a40-466b-ab43-86e768ce9c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 (63f5e52b-d2a6-47a8-8fa8-b2927a0551b3): created successfully Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d237e2cc-3a40-466b-ab43-86e768ce9c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (38b5008f-3aee-4c9c-9315-64fbd3f11105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-98b292e9-579d-4bad-9a23-8c63ca5660d2 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created volume successfully. Sep 12 07:30:50 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f 1073741824" returned: 0 in 0.486s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:50 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f Sep 12 07:30:50 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:50 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee0980a-bd7c-499a-a37e-f49319e9ee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197b023b-1ffe-4f35-a91f-1dcdd830114f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47631235-c6b8-49a3-8d2d-d9505fdb3560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:30:50 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Volume volume-197b023b-1ffe-4f35-a91f-1dcdd830114f (197b023b-1ffe-4f35-a91f-1dcdd830114f): created successfully Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47631235-c6b8-49a3-8d2d-d9505fdb3560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:30:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Flow 'volume_create_manager' (8fbd480c-92f8-4e34-b5ca-03443c886f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:30:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d8ccbffd-7461-4ee8-9ecb-2c17954ba35e tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created volume successfully. Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-197b023b-1ffe-4f35-a91f-1dcdd830114f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-197b023b-1ffe-4f35-a91f-1dcdd830114f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-197b023b-1ffe-4f35-a91f-1dcdd830114f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-197b023b-1ffe-4f35-a91f-1dcdd830114f" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8f161e-9f5f-4473-b6cd-557b326017c9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:51 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f Sep 12 07:30:51 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:51 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:51 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f Sep 12 07:30:51 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:51 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-197b023b-1ffe-4f35-a91f-1dcdd830114f" returned: 0 in 0.258s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-197b023b-1ffe-4f35-a91f-1dcdd830114f" released by "delete_volume" :: held 0.763s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['95556d44-b678-4c26-ba58-9c2021a2fcdb', '5deeb181-e8cc-4d29-a951-fb87856a23b8', '4cbe29a8-df14-4577-89b9-34993efed23b', '4a99029e-dd97-4fb6-89a8-13c95f0fea89'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:52 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:52 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:52 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleted volume successfully. Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a0c2b7-9eb5-4c11-9775-531e3d1cd5f2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7e028173-76a8-4b35-8fd9-fb065e701257 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-197b023b-1ffe-4f35-a91f-1dcdd830114f-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:52 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 Sep 12 07:30:52 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:52 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:52 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3 Sep 12 07:30:52 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:53 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3" released by "delete_volume" :: held 0.777s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['e616c11b-d6e9-4654-8786-2b28f8852819', '4b9336a4-f89b-4ff2-9f64-33da833b2fe0', 'db8d1349-8c10-4052-9bbc-1790e041cb50', '92050124-962e-47df-94b3-eb5eac7fd3bc'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:53 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:53 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-7eff8bdf-6bfa-4d77-8243-f80acbf2011e-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-7eff8bdf-6bfa-4d77-8243-f80acbf2011e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-7eff8bdf-6bfa-4d77-8243-f80acbf2011e" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-7eff8bdf-6bfa-4d77-8243-f80acbf2011e" acquired by "delete_volume" :: waited 0.040s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc9b4d-0168-4472-931b-afada57b2480]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:53 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.325s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:53 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleted volume successfully. Sep 12 07:30:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-47d954e6-ed92-4b24-b23c-1e2b68575f68 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-63f5e52b-d2a6-47a8-8fa8-b2927a0551b3-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:53 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e Sep 12 07:30:53 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:54 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:54 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e Sep 12 07:30:54 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:54 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7eff8bdf-6bfa-4d77-8243-f80acbf2011e" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-7eff8bdf-6bfa-4d77-8243-f80acbf2011e" released by "delete_volume" :: held 0.712s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['72ff1f6f-6576-4f0f-aa51-1451c136bdf1', '9681a142-d53e-41d8-abe5-614048992e6b', '3aa392b2-3083-4377-96e4-c339062099e9', 'c781f0f9-3d8c-4a93-a708-d91910e5821d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:54 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:54 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:54 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleted volume successfully. Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-bbfd6c45-e488-4c9d-aa50-3fef17c29432-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-0cfd7337-155c-4a2d-8c92-ff88baa89a38 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-7eff8bdf-6bfa-4d77-8243-f80acbf2011e-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-bbfd6c45-e488-4c9d-aa50-3fef17c29432-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-bbfd6c45-e488-4c9d-aa50-3fef17c29432" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-bbfd6c45-e488-4c9d-aa50-3fef17c29432" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c81decb-14c9-4522-967d-a40fabcc78a2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:55 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 Sep 12 07:30:55 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:55 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432" returned: 0 in 0.362s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:55 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432 Sep 12 07:30:55 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:55 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bbfd6c45-e488-4c9d-aa50-3fef17c29432" returned: 0 in 0.318s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-bbfd6c45-e488-4c9d-aa50-3fef17c29432" released by "delete_volume" :: held 0.718s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['66f6e894-ed61-4815-8b21-1bf10c213099', '55fc8c7a-692b-4089-bf1f-f5d437d04e78', '697ed169-4c2d-4a56-ba0e-2d94aa2344b8', '396dbcf8-918d-460e-baa9-83c8c6cae39d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:55 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:55 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-7e71f3a5-6522-4be3-9c71-cd900eed84e0-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-7e71f3a5-6522-4be3-9c71-cd900eed84e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-7e71f3a5-6522-4be3-9c71-cd900eed84e0" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.309s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:56 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleted volume successfully. Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-7e71f3a5-6522-4be3-9c71-cd900eed84e0" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b226986c-3ef6-45aa-81ba-d0b0c3bf448f tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-bbfd6c45-e488-4c9d-aa50-3fef17c29432-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[053a721b-cae6-4e40-8722-46ee4056d4ea]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:56 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 Sep 12 07:30:56 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:56 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:56 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0 Sep 12 07:30:56 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:56 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-7e71f3a5-6522-4be3-9c71-cd900eed84e0" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-7e71f3a5-6522-4be3-9c71-cd900eed84e0" released by "delete_volume" :: held 0.644s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['f7cd35ea-05f3-4718-967f-59e200b4c290', '42d2cf80-91e1-4efe-bc48-c49965de6440', 'f0f7a97d-65da-4613-acdb-8f2e53f02378', '2199da9a-94d6-4623-9538-648c7e27b972'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:30:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:56 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:30:56 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:57 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:30:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleted volume successfully. Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2ef4077c-a41b-4b72-abd1-8525f06c9f64 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-7e71f3a5-6522-4be3-9c71-cd900eed84e0-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-8edffb66-bb2e-41ed-aaba-5eeea175ea6a-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-8edffb66-bb2e-41ed-aaba-5eeea175ea6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-8edffb66-bb2e-41ed-aaba-5eeea175ea6a" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-8edffb66-bb2e-41ed-aaba-5eeea175ea6a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleting offline snapshot 8edffb66-bb2e-41ed-aaba-5eeea175ea6a of volume 4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] snapshot_file for this snap is: volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26aac9e-3856-4017-b6c5-7946e26c4cd1]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:57 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a Sep 12 07:30:57 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:57 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a" returned: 0 in 0.386s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97f185-dc3d-48c8-9872-e6cc71dc6040]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:57 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e Sep 12 07:30:57 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:58 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:58 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a Sep 12 07:30:58 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:58 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a" returned: 0 in 0.336s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:58 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a Sep 12 07:30:58 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:58 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e.8edffb66-bb2e-41ed-aaba-5eeea175ea6a" returned: 0 in 0.264s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-8edffb66-bb2e-41ed-aaba-5eeea175ea6a" released by "_delete_snapshot" :: held 1.506s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" released by "delete_snapshot" :: held 1.529s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['cdd9ee1a-1ce2-499e-999e-89eabe4589f2', '5e8890e1-58a0-4bbb-8847-29bf77c58c12', '356c8eb3-06aa-4009-8e12-c3366642e512', '47661e9a-2493-4edb-ad30-4d01c26c2daa'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:30:58 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Delete snapshot completed successfully. Sep 12 07:30:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e259d318-e939-4d35-af26-452f5a6566ed tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-8edffb66-bb2e-41ed-aaba-5eeea175ea6a-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-4582ffa9-0f47-4b7b-9605-f67f03edfc1e-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-4582ffa9-0f47-4b7b-9605-f67f03edfc1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "cinder-quobyte-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" acquired by "delete_volume" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e9439-9cce-44bd-9e55-b8bb0f3b3660]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:59 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e Sep 12 07:30:59 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:30:59 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:30:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:30:59 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e Sep 12 07:30:59 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:00 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" returned: 0 in 0.254s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-quobyte-4582ffa9-0f47-4b7b-9605-f67f03edfc1e" released by "delete_volume" :: held 0.692s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Created reservations ['d1b46939-76f1-404a-966e-35e9a74c3193', '9159905f-9ffa-4856-b147-7a55343abdff', '799e473b-7478-4c36-90eb-e5153ae70792', '24637f5a-2e6a-4712-bdb9-0a882d372dd2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:00 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:31:00 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:00 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:31:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Deleted volume successfully. Sep 12 07:31:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-49484d3f-c7e1-4b93-935d-535279ac1988 tempest-CreateVolumesFromSnapshotTest-1775689465 None] Lock "cinder-4582ffa9-0f47-4b7b-9605-f67f03edfc1e-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=103,cinder:INSERT=26,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=76,cinder:UPDATE=112,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Flow 'volume_create_manager' (0336c56a-14a9-425e-8620-a282e7f9d3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20decd9b-ff24-4b0f-abfd-307d7787f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20decd9b-ff24-4b0f-abfd-307d7787f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1047992586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe64cf4-46d2-4550-b81e-d5e88e46d56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377a28eaffdd49f6ba9210bff4774445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:05Z,use_quota=True,user_id='c8efe440e2584163a527b1849b8142d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570d1897-8284-476d-931a-9eeb3d24c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570d1897-8284-476d-931a-9eeb3d24c03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba9b31b-6fde-4da7-883b-814d43c2e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba9b31b-6fde-4da7-883b-814d43c2e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe64cf4-46d2-4550-b81e-d5e88e46d56f', 'volume_name': 'volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b15eb9-8c70-427f-95c9-ac4ffe4ffdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b15eb9-8c70-427f-95c9-ac4ffe4ffdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b88b888-8d91-4bd4-b695-6da893208bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:04 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Volume 4fe64cf4-46d2-4550-b81e-d5e88e46d56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f', 'volume_size': 1} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1047992586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe64cf4-46d2-4550-b81e-d5e88e46d56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377a28eaffdd49f6ba9210bff4774445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:05Z,use_quota=True,user_id='c8efe440e2584163a527b1849b8142d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Creating volume 4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:31:04 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:31:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:04 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f 1073741824 Sep 12 07:31:04 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:05 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f 1073741824" returned: 0 in 0.536s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:05 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f Sep 12 07:31:05 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Flow 'volume_create_manager' (ff25ccf5-5ffd-4149-86b1-2e1a667910f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56be3c-9e18-4255-996f-8c0f6c48d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56be3c-9e18-4255-996f-8c0f6c48d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-448102256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccdd68e-501f-4154-92e7-b666bf91ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a059c840881144c99329ba9b4aef1b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:05Z,use_quota=True,user_id='8058e667f573445e955609273abafa82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377c9ab-7d20-43b7-9ee0-afd06c8807eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377c9ab-7d20-43b7-9ee0-afd06c8807eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e6bfa0-d466-43d3-a18a-43d90c68f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e6bfa0-d466-43d3-a18a-43d90c68f925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccdd68e-501f-4154-92e7-b666bf91ec32', 'volume_name': 'volume-2ccdd68e-501f-4154-92e7-b666bf91ec32', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed3961c-b180-45db-8ee3-e16d31ceae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed3961c-b180-45db-8ee3-e16d31ceae2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750388f0-62c5-4bf1-8d7f-4840c2153322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Volume 2ccdd68e-501f-4154-92e7-b666bf91ec32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccdd68e-501f-4154-92e7-b666bf91ec32', 'volume_size': 1} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:05 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" returned: 0 in 0.300s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-448102256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccdd68e-501f-4154-92e7-b666bf91ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a059c840881144c99329ba9b4aef1b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:05Z,use_quota=True,user_id='8058e667f573445e955609273abafa82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Creating volume 2ccdd68e-501f-4154-92e7-b666bf91ec32 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:31:05 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b88b888-8d91-4bd4-b695-6da893208bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:05 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 1073741824 Sep 12 07:31:05 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8f0ab-a4a1-4348-bf7f-b5712c3acadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Volume volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f (4fe64cf4-46d2-4550-b81e-d5e88e46d56f): created successfully Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8f0ab-a4a1-4348-bf7f-b5712c3acadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Flow 'volume_create_manager' (0336c56a-14a9-425e-8620-a282e7f9d3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7340cfed-c630-419c-83d7-b908fd11af99 tempest-VolumeDependencyTests-2009056410 None] Created volume successfully. Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Flow 'volume_create_manager' (e981d253-d816-4242-a798-f8d19fe7310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13439152-4afd-4da1-9dcc-db6a6c3849bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13439152-4afd-4da1-9dcc-db6a6c3849bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1274294535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c51298-d3aa-44f7-9081-55b11f6a0786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a059c840881144c99329ba9b4aef1b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:06Z,use_quota=True,user_id='8058e667f573445e955609273abafa82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83dddd-f091-455c-9e82-eaeb697005e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83dddd-f091-455c-9e82-eaeb697005e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c3b079-1b3d-4ed2-8ac3-79ea97938c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:06 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c3b079-1b3d-4ed2-8ac3-79ea97938c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c51298-d3aa-44f7-9081-55b11f6a0786', 'volume_name': 'volume-d4c51298-d3aa-44f7-9081-55b11f6a0786', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed47ba40-1816-4ea2-8599-ce46f0160c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed47ba40-1816-4ea2-8599-ce46f0160c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f6f8c7-f11a-47a6-a3c7-851ed3542ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Volume d4c51298-d3aa-44f7-9081-55b11f6a0786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c51298-d3aa-44f7-9081-55b11f6a0786', 'volume_size': 1} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 1073741824" returned: 0 in 0.537s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:06 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 Sep 12 07:31:06 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:06 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1274294535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c51298-d3aa-44f7-9081-55b11f6a0786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a059c840881144c99329ba9b4aef1b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:06Z,use_quota=True,user_id='8058e667f573445e955609273abafa82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Creating volume d4c51298-d3aa-44f7-9081-55b11f6a0786 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:31:06 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750388f0-62c5-4bf1-8d7f-4840c2153322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccdd68e-501f-4154-92e7-b666bf91ec32', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:06 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 1073741824 Sep 12 07:31:06 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b42c91-cb57-4d5e-b8e2-0d20fa039cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Volume volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 (2ccdd68e-501f-4154-92e7-b666bf91ec32): created successfully Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b42c91-cb57-4d5e-b8e2-0d20fa039cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Flow 'volume_create_manager' (ff25ccf5-5ffd-4149-86b1-2e1a667910f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d6aa3eb1-4353-4f5c-9be5-ce40699a9f64 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Created volume successfully. Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:06 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 1073741824" returned: 0 in 0.502s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:07 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 Sep 12 07:31:07 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:07 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786" returned: 0 in 0.258s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.332s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f6f8c7-f11a-47a6-a3c7-851ed3542ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c51298-d3aa-44f7-9081-55b11f6a0786', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c7757f-666a-41ce-84e1-fe03d6281859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Creating offline snapshot b775bca0-191f-48b3-a6c5-5f940ed471c7 of volume 4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:31:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Volume volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 (d4c51298-d3aa-44f7-9081-55b11f6a0786): created successfully Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c7757f-666a-41ce-84e1-fe03d6281859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Flow 'volume_create_manager' (e981d253-d816-4242-a798-f8d19fe7310b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9989d6b2-04cf-4efa-a68d-07b3ffc3e641]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fec1b9d5-be21-4d74-860f-5c4839c6d816 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Created volume successfully. Sep 12 07:31:07 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f Sep 12 07:31:07 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:07 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" returned: 0 in 0.393s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:07 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 1G Sep 12 07:31:07 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:08 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 1G" returned: 0 in 0.436s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:08 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 Sep 12 07:31:08 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:08 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7" returned: 0 in 0.290s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:08 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 is being set with open permissions: ugo+rw Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:08 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 Sep 12 07:31:08 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:08 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:08 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info Sep 12 07:31:08 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:08 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info" returned: 0 in 0.284s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:08 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info is being set with open permissions: ugo+rw Sep 12 07:31:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:09 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info Sep 12 07:31:09 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:09 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.info" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-81042796-026d-43f2-8009-cac9b66106e4 tempest-VolumeDependencyTests-2009056410 None] Create snapshot completed successfully Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Flow 'volume_create_manager' (221f9eb8-3fa4-4f1b-9655-a8d26185c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a672e62-dfa0-4bd9-84e3-1c43a0e96c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a672e62-dfa0-4bd9-84e3-1c43a0e96c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1418117221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89735fdc-aa62-44c4-a436-c7a71f47bfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377a28eaffdd49f6ba9210bff4774445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b775bca0-191f-48b3-a6c5-5f940ed471c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:31:11Z,use_quota=True,user_id='c8efe440e2584163a527b1849b8142d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e32f24-e125-4ab8-8ffd-d0583123b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e32f24-e125-4ab8-8ffd-d0583123b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e6131d-d488-4979-b664-72bb9f8c3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e6131d-d488-4979-b664-72bb9f8c3913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89735fdc-aa62-44c4-a436-c7a71f47bfdf', 'volume_name': 'volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf', 'volume_size': 1, 'snapshot_id': 'b775bca0-191f-48b3-a6c5-5f940ed471c7'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42f386b-a8f4-4f8f-940a-0880d2c857f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42f386b-a8f4-4f8f-940a-0880d2c857f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4db87b-7845-4577-8944-200f6f2b079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Volume 89735fdc-aa62-44c4-a436-c7a71f47bfdf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf', 'volume_size': 1, 'snapshot_id': 'b775bca0-191f-48b3-a6c5-5f940ed471c7'} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-quobyte-b775bca0-191f-48b3-a6c5-5f940ed471c7-89735fdc-aa62-44c4-a436-c7a71f47bfdf" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-b775bca0-191f-48b3-a6c5-5f940ed471c7-89735fdc-aa62-44c4-a436-c7a71f47bfdf" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Creating volume 89735fdc-aa62-44c4-a436-c7a71f47bfdf from snapshot b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-quobyte-89735fdc-aa62-44c4-a436-c7a71f47bfdf" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-89735fdc-aa62-44c4-a436-c7a71f47bfdf" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] snapshot: b775bca0-191f-48b3-a6c5-5f940ed471c7, volume: 89735fdc-aa62-44c4-a436-c7a71f47bfdf, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7461c-d3f6-48c1-98e7-30595f53542b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:11 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 Sep 12 07:31:11 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:11 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7" returned: 0 in 0.395s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c612f3-949d-43aa-a030-b054c07f3669]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:11 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f Sep 12 07:31:11 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:11 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" returned: 0 in 0.374s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:31:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:11 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf Sep 12 07:31:11 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:18 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf" returned: 0 in 6.586s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:31:18 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Converted 1024.00 MB image at 155.43 MB/s Sep 12 07:31:18 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf is being set with open permissions: ugo+rw Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:18 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf Sep 12 07:31:18 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:18 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-89735fdc-aa62-44c4-a436-c7a71f47bfdf" released by "_copy_volume_from_snapshot" :: held 7.750s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-b775bca0-191f-48b3-a6c5-5f940ed471c7-89735fdc-aa62-44c4-a436-c7a71f47bfdf" released by "_create_volume_from_snapshot" :: held 7.842s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.864s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4db87b-7845-4577-8944-200f6f2b079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf', 'volume_size': 1, 'snapshot_id': 'b775bca0-191f-48b3-a6c5-5f940ed471c7'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf21778-d9d1-4ebc-ab8f-fc06cc20e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:31:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Volume volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf (89735fdc-aa62-44c4-a436-c7a71f47bfdf): created successfully Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf21778-d9d1-4ebc-ab8f-fc06cc20e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Flow 'volume_create_manager' (221f9eb8-3fa4-4f1b-9655-a8d26185c89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:31:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-13da4c56-236b-4970-80a1-8bee54dc45ef tempest-VolumeDependencyTests-2009056410 None] Created volume successfully. Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-b775bca0-191f-48b3-a6c5-5f940ed471c7-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-b775bca0-191f-48b3-a6c5-5f940ed471c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-quobyte-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-quobyte-b775bca0-191f-48b3-a6c5-5f940ed471c7" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-b775bca0-191f-48b3-a6c5-5f940ed471c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Deleting offline snapshot b775bca0-191f-48b3-a6c5-5f940ed471c7 of volume 4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] snapshot_file for this snap is: volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285fad6-a16b-4132-83f5-bfb4790450b5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:19 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 Sep 12 07:31:19 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:19 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816116d-daa5-467a-bf9e-da7890086c53]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:19 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f Sep 12 07:31:19 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:20 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" returned: 0 in 0.518s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:20 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 Sep 12 07:31:20 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:20 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:20 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7 Sep 12 07:31:20 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:20 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f.b775bca0-191f-48b3-a6c5-5f940ed471c7" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-b775bca0-191f-48b3-a6c5-5f940ed471c7" released by "_delete_snapshot" :: held 1.696s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" released by "delete_snapshot" :: held 1.725s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Created reservations ['38988028-0663-4855-b9c0-bdfca34115b7', '387c37dc-71c0-4c6e-90a5-d7fa83120bcd', '332733d8-0174-4fdc-9f60-55e2ccda5db4', '53c2d4dc-e0eb-419a-9ab0-69cb1f0f203e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:31:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Delete snapshot completed successfully. Sep 12 07:31:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f99be0ea-b086-4168-a81c-8696f69b434d tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-b775bca0-191f-48b3-a6c5-5f940ed471c7-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-4fe64cf4-46d2-4550-b81e-d5e88e46d56f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-4fe64cf4-46d2-4550-b81e-d5e88e46d56f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-quobyte-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c5a110-b08f-4cc1-8cbe-ce802a880630]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:21 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f Sep 12 07:31:21 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:21 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" returned: 0 in 0.358s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:21 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f Sep 12 07:31:21 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:21 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-4fe64cf4-46d2-4550-b81e-d5e88e46d56f" released by "delete_volume" :: held 0.659s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Created reservations ['bb8a3e5a-920b-4c80-9b20-d52e59e4376d', '9a81966e-5cac-42e7-902c-4b27d5466631', '800ce83f-7bf5-4de1-b5e9-84e15175c195', '40b8dd1b-c9e7-4f77-8c39-298a6b4ee947'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:22 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:31:22 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:22 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.268s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:31:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Deleted volume successfully. Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-175837e9-8369-44eb-bb77-30f3abce0e1c tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-4fe64cf4-46d2-4550-b81e-d5e88e46d56f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-89735fdc-aa62-44c4-a436-c7a71f47bfdf-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-89735fdc-aa62-44c4-a436-c7a71f47bfdf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "cinder-quobyte-89735fdc-aa62-44c4-a436-c7a71f47bfdf" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-89735fdc-aa62-44c4-a436-c7a71f47bfdf" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[326200ed-507d-4d3d-a28d-8bb5d84c7aa7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:22 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf Sep 12 07:31:22 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:22 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:22 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf Sep 12 07:31:22 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:22 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-89735fdc-aa62-44c4-a436-c7a71f47bfdf" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-quobyte-89735fdc-aa62-44c4-a436-c7a71f47bfdf" released by "delete_volume" :: held 0.631s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Created reservations ['550d3e3e-c927-40f2-884d-f723df499bb4', '6145bdd1-aaea-4b1d-b949-1a40e7f833c8', '8efa5e00-3515-4591-bc0f-c81dbb33deed', '039a19b6-6cef-49da-a834-aa032f48a3f0'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:23 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:31:23 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:23 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:31:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Deleted volume successfully. Sep 12 07:31:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d46c4633-f384-497b-b54e-9f2a20b19298 tempest-VolumeDependencyTests-2009056410 None] Lock "cinder-89735fdc-aa62-44c4-a436-c7a71f47bfdf-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:30 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:31:30 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:30 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:31:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:31:33 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=34,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=10 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:31:33 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=22,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:31:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-d9c1b229-c510-4138-ad8d-3806fd23a410 req-604e7abd-eab2-4e87-8c00-9938d6f1fed2 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-d9c1b229-c510-4138-ad8d-3806fd23a410 req-604e7abd-eab2-4e87-8c00-9938d6f1fed2 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-d9c1b229-c510-4138-ad8d-3806fd23a410 req-604e7abd-eab2-4e87-8c00-9938d6f1fed2 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-d9c1b229-c510-4138-ad8d-3806fd23a410 req-604e7abd-eab2-4e87-8c00-9938d6f1fed2 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-2ccdd68e-501f-4154-92e7-b666bf91ec32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1b54fc6-b762-4ca3-9309-7b3ac64a9826', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:31:40 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-d9c1b229-c510-4138-ad8d-3806fd23a410 req-604e7abd-eab2-4e87-8c00-9938d6f1fed2 tempest-TestServerVolumeAttachmentScenario-1958470369 None] attachment_update completed successfully. Sep 12 07:31:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-24557677-6c9b-4156-bffe-f4af21961b3d req-0411ca6c-33ab-4f48-afe8-30d481b12cb3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-24557677-6c9b-4156-bffe-f4af21961b3d req-0411ca6c-33ab-4f48-afe8-30d481b12cb3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [req-24557677-6c9b-4156-bffe-f4af21961b3d req-0411ca6c-33ab-4f48-afe8-30d481b12cb3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-24557677-6c9b-4156-bffe-f4af21961b3d req-0411ca6c-33ab-4f48-afe8-30d481b12cb3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287', 'name': 'volume-d4c51298-d3aa-44f7-9081-55b11f6a0786', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '682e7ad2-2a73-4b86-8a29-6e1c2f16153b', 'enforce_multipath': True} {{(pid=88013) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 12 07:31:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-24557677-6c9b-4156-bffe-f4af21961b3d req-0411ca6c-33ab-4f48-afe8-30d481b12cb3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] attachment_update completed successfully. Sep 12 07:31:45 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-a6ae4373-a674-4405-96de-989f02e1e36e req-b3dee91f-74e0-4e3a-8ad9-4bd224cd379a tempest-TestServerVolumeAttachmentScenario-1958470369 None] Terminate volume connection completed successfully. Sep 12 07:31:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-a6ae4373-a674-4405-96de-989f02e1e36e req-b3dee91f-74e0-4e3a-8ad9-4bd224cd379a tempest-TestServerVolumeAttachmentScenario-1958470369 None] Deleting attachment 682e7ad2-2a73-4b86-8a29-6e1c2f16153b. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:31:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [req-57c0684a-c243-453b-88ba-d77dade1e367 req-da142e64-2114-4d99-b704-7e23690d40bc tempest-TestServerVolumeAttachmentScenario-1958470369 None] Terminate volume connection completed successfully. Sep 12 07:31:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [req-57c0684a-c243-453b-88ba-d77dade1e367 req-da142e64-2114-4d99-b704-7e23690d40bc tempest-TestServerVolumeAttachmentScenario-1958470369 None] Deleting attachment b1b54fc6-b762-4ca3-9309-7b3ac64a9826. {{(pid=88013) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "cinder-d4c51298-d3aa-44f7-9081-55b11f6a0786-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-d4c51298-d3aa-44f7-9081-55b11f6a0786-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "cinder-quobyte-d4c51298-d3aa-44f7-9081-55b11f6a0786" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-quobyte-d4c51298-d3aa-44f7-9081-55b11f6a0786" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[892c7f7c-c330-410d-850e-a3acaef744a4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:51 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 Sep 12 07:31:51 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:51 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:51 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786 Sep 12 07:31:51 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:52 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d4c51298-d3aa-44f7-9081-55b11f6a0786" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-quobyte-d4c51298-d3aa-44f7-9081-55b11f6a0786" released by "delete_volume" :: held 0.651s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Created reservations ['e104b724-b214-41f4-bb6d-3805eac0c17b', '0616c82b-ed2c-4b04-99e8-3e149d7afa18', '49c5e9f8-066b-458d-b660-d731e30395ca', '6f852f49-e2af-427d-a714-14835845dc32'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:52 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:31:52 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:52 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:31:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Deleted volume successfully. Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e45d2e49-c843-4687-b3f3-39f99c33e0f3 tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-d4c51298-d3aa-44f7-9081-55b11f6a0786-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "cinder-2ccdd68e-501f-4154-92e7-b666bf91ec32-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-2ccdd68e-501f-4154-92e7-b666bf91ec32-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "cinder-quobyte-2ccdd68e-501f-4154-92e7-b666bf91ec32" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-quobyte-2ccdd68e-501f-4154-92e7-b666bf91ec32" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55bbe7-3694-456b-b499-7991aed465e2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:31:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:52 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 Sep 12 07:31:52 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:53 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32" returned: 0 in 0.358s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:53 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32 Sep 12 07:31:53 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:53 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2ccdd68e-501f-4154-92e7-b666bf91ec32" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-quobyte-2ccdd68e-501f-4154-92e7-b666bf91ec32" released by "delete_volume" :: held 0.636s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Created reservations ['a16b5183-5528-403e-a1ea-340d0eb94ac3', '0e1c458c-34e2-4ad3-a349-e085d5f0eee6', '04ef0cd9-3c29-4fcd-a3a5-6c55696c3773', '7df7535a-5a76-49f9-9e9d-a496c63da25c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:31:53 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:31:53 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:31:53 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:31:53 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Deleted volume successfully. Sep 12 07:31:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-68a53206-fbff-42a0-9b83-44a33b1e5f1c tempest-TestServerVolumeAttachmentScenario-1958470369 None] Lock "cinder-2ccdd68e-501f-4154-92e7-b666bf91ec32-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:03 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=22,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:32:03 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (52311dfb-1cd7-437a-b9a2-2bfca94b6c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ca32e1-3b2e-44e7-ab07-b86379dbc74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ca32e1-3b2e-44e7-ab07-b86379dbc74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320171026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb428b0c-69df-4459-9438-c9d046dc8674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:04Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a26f3c-8040-4271-a509-e55ce0dde3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a26f3c-8040-4271-a509-e55ce0dde3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6c015-b5cf-44b0-9e4f-24f7e7902e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6c015-b5cf-44b0-9e4f-24f7e7902e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb428b0c-69df-4459-9438-c9d046dc8674', 'volume_name': 'volume-bb428b0c-69df-4459-9438-c9d046dc8674', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d50a6cd-0a8c-49c2-9541-772afad2144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d50a6cd-0a8c-49c2-9541-772afad2144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d20fd2-4b3e-4eb5-8942-37bde0fa2d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Volume bb428b0c-69df-4459-9438-c9d046dc8674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb428b0c-69df-4459-9438-c9d046dc8674', 'volume_size': 1} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320171026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb428b0c-69df-4459-9438-c9d046dc8674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:04Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Creating volume bb428b0c-69df-4459-9438-c9d046dc8674 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:04 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:04 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 1073741824 Sep 12 07:32:04 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (d803d07c-085c-43e8-814b-469f85cf17bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81df3c5-3d35-47c1-b205-a77c50a9b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81df3c5-3d35-47c1-b205-a77c50a9b27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101797616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:05Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eec9e37-f40a-42ab-9373-d5eb31985ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eec9e37-f40a-42ab-9373-d5eb31985ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819344fb-de68-4929-8895-7ac89d328267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819344fb-de68-4929-8895-7ac89d328267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64', 'volume_name': 'volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00840c98-ca2b-4216-b447-05684bff0e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00840c98-ca2b-4216-b447-05684bff0e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05cb860-d72d-492f-9bb7-5a99d4cff15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:04 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Volume 9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64', 'volume_size': 1} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:04 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 1073741824" returned: 0 in 0.464s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:04 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 Sep 12 07:32:04 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (be4f13eb-e5f2-4812-bb0a-f6347b1599fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e14e7a-404b-407b-bf0c-e89ab66f059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e14e7a-404b-407b-bf0c-e89ab66f059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771419578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cd25cc-1bea-40d8-ab33-c07043e0e53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:05Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef27d27-b33f-441f-bf90-9a3f354b42da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef27d27-b33f-441f-bf90-9a3f354b42da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624d1877-8be3-4e8e-8c2f-040f88e69539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624d1877-8be3-4e8e-8c2f-040f88e69539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2cd25cc-1bea-40d8-ab33-c07043e0e53d', 'volume_name': 'volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160edc2e-8376-48d1-9a6c-10feaf3555c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160edc2e-8376-48d1-9a6c-10feaf3555c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376d42ac-79af-414f-aecd-b8944929bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Volume b2cd25cc-1bea-40d8-ab33-c07043e0e53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d', 'volume_size': 1} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:05 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101797616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:05Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Creating volume 9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:05 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d20fd2-4b3e-4eb5-8942-37bde0fa2d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb428b0c-69df-4459-9438-c9d046dc8674', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda91b2-8f4d-4dfc-8169-60d1d160ddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 1073741824 Sep 12 07:32:05 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Volume volume-bb428b0c-69df-4459-9438-c9d046dc8674 (bb428b0c-69df-4459-9438-c9d046dc8674): created successfully Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda91b2-8f4d-4dfc-8169-60d1d160ddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (52311dfb-1cd7-437a-b9a2-2bfca94b6c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b942f76d-9958-4699-a644-8f9683735893 tempest-CreateVolumesFromImageTest-1352397235 None] Created volume successfully. Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (83b1737e-d7c3-4a8c-8d73-fe0e6ea6ba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57968d5d-8d17-46ab-a24c-a11ab3f45dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57968d5d-8d17-46ab-a24c-a11ab3f45dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351238045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcdc150-e0b7-4cb2-8832-d83c169f2147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:05Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3753ce9b-5b1d-4007-a4e1-daab499f2375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3753ce9b-5b1d-4007-a4e1-daab499f2375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3426aa-16ce-43f6-ace7-d226846a73da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3426aa-16ce-43f6-ace7-d226846a73da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcdc150-e0b7-4cb2-8832-d83c169f2147', 'volume_name': 'volume-afcdc150-e0b7-4cb2-8832-d83c169f2147', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0e6c61-8878-4c7f-bdcb-f01f301b9d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0e6c61-8878-4c7f-bdcb-f01f301b9d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66f566a-e73f-4c82-aea3-eb0f6dcac6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Volume afcdc150-e0b7-4cb2-8832-d83c169f2147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcdc150-e0b7-4cb2-8832-d83c169f2147', 'volume_size': 1} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:05 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 1073741824" returned: 0 in 0.456s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:05 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 Sep 12 07:32:05 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (a064a6a1-3b6d-48cb-bb25-2959998a48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f599da-1226-4380-b554-c2e635d0ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f599da-1226-4380-b554-c2e635d0ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994176911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fb091f-8c9f-4281-9b27-f6e683ecc0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:06Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6099fedf-98cb-42fd-9368-8b40c2c61db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6099fedf-98cb-42fd-9368-8b40c2c61db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d757e5-a5bd-41ca-aa25-011dea64b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d757e5-a5bd-41ca-aa25-011dea64b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fb091f-8c9f-4281-9b27-f6e683ecc0c5', 'volume_name': 'volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320b01f7-4041-4421-8982-b1f5934953de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320b01f7-4041-4421-8982-b1f5934953de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c067948e-12b7-4f57-bc90-c8f911fb3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Volume 39fb091f-8c9f-4281-9b27-f6e683ecc0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5', 'volume_size': 1} Sep 12 07:32:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:06 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771419578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cd25cc-1bea-40d8-ab33-c07043e0e53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:05Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Creating volume b2cd25cc-1bea-40d8-ab33-c07043e0e53d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:06 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05cb860-d72d-492f-9bb7-5a99d4cff15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:06 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d 1073741824 Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb81e81-cc89-4516-a732-42fd5b1f3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:06 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Volume volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 (9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64): created successfully Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb81e81-cc89-4516-a732-42fd5b1f3d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (d803d07c-085c-43e8-814b-469f85cf17bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0c8e0cc5-f69b-47c0-b49d-113265528c11 tempest-CreateVolumesFromImageTest-1352397235 None] Created volume successfully. Sep 12 07:32:06 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d 1073741824" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:06 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d Sep 12 07:32:06 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:06 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d" returned: 0 in 0.236s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351238045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcdc150-e0b7-4cb2-8832-d83c169f2147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:05Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Creating volume afcdc150-e0b7-4cb2-8832-d83c169f2147 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:06 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:06 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 1073741824 Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376d42ac-79af-414f-aecd-b8944929bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:06 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8131d8-24e6-4eef-bdf9-7f379a5cc4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Volume volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d (b2cd25cc-1bea-40d8-ab33-c07043e0e53d): created successfully Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8131d8-24e6-4eef-bdf9-7f379a5cc4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (be4f13eb-e5f2-4812-bb0a-f6347b1599fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9c28fb75-044a-41b1-a2ee-305642db5d62 tempest-CreateVolumesFromImageTest-1352397235 None] Created volume successfully. Sep 12 07:32:07 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 1073741824" returned: 0 in 0.398s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:07 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 Sep 12 07:32:07 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:07 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994176911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fb091f-8c9f-4281-9b27-f6e683ecc0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c494e304ea043f782754dc2508b0992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:06Z,use_quota=True,user_id='0af86e00564c45f489179ff890c9a6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Creating volume 39fb091f-8c9f-4281-9b27-f6e683ecc0c5 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:07 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66f566a-e73f-4c82-aea3-eb0f6dcac6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcdc150-e0b7-4cb2-8832-d83c169f2147', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:07 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 1073741824 Sep 12 07:32:07 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af91140-e374-43ed-9cf5-0bc33993b724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Volume volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 (afcdc150-e0b7-4cb2-8832-d83c169f2147): created successfully Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af91140-e374-43ed-9cf5-0bc33993b724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (83b1737e-d7c3-4a8c-8d73-fe0e6ea6ba5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-eb29e54c-fabe-4d1d-900b-6dca9d008715 tempest-CreateVolumesFromImageTest-1352397235 None] Created volume successfully. Sep 12 07:32:07 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 1073741824" returned: 0 in 0.385s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:07 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 Sep 12 07:32:07 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:08 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c067948e-12b7-4f57-bc90-c8f911fb3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729a0e53-69b5-4cfb-976c-1a3b094bf517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Volume volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 (39fb091f-8c9f-4281-9b27-f6e683ecc0c5): created successfully Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729a0e53-69b5-4cfb-976c-1a3b094bf517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Flow 'volume_create_manager' (a064a6a1-3b6d-48cb-bb25-2959998a48ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f57137db-449d-439f-8c93-60bf2931921a tempest-CreateVolumesFromImageTest-1352397235 None] Created volume successfully. Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-39fb091f-8c9f-4281-9b27-f6e683ecc0c5-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-39fb091f-8c9f-4281-9b27-f6e683ecc0c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-quobyte-39fb091f-8c9f-4281-9b27-f6e683ecc0c5" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-39fb091f-8c9f-4281-9b27-f6e683ecc0c5" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763ccb4-c3f8-410f-bff0-c46811aea5f0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:09 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 Sep 12 07:32:09 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:09 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5" returned: 0 in 0.344s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:09 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5 Sep 12 07:32:09 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:09 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39fb091f-8c9f-4281-9b27-f6e683ecc0c5" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-39fb091f-8c9f-4281-9b27-f6e683ecc0c5" released by "delete_volume" :: held 0.615s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Created reservations ['2da09bbd-fde7-4d0c-8e94-6ebf50259a2f', 'f0fa7a6d-a1c8-4368-a014-25bcffd7b583', 'c25cd9c0-d2b2-468b-a5f3-5114833ceaea', '50512544-aad9-4482-8a7f-adc0f993e813'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:09 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:09 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:10 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Deleted volume successfully. Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4eb59781-f44c-442c-a4e7-23d63ff5fa91 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-39fb091f-8c9f-4281-9b27-f6e683ecc0c5-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-afcdc150-e0b7-4cb2-8832-d83c169f2147-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-afcdc150-e0b7-4cb2-8832-d83c169f2147-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-quobyte-afcdc150-e0b7-4cb2-8832-d83c169f2147" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-afcdc150-e0b7-4cb2-8832-d83c169f2147" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8cb4a1-9297-40a7-9725-75c886f0eb47]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:10 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 Sep 12 07:32:10 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:10 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:10 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147 Sep 12 07:32:10 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:11 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-afcdc150-e0b7-4cb2-8832-d83c169f2147" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-afcdc150-e0b7-4cb2-8832-d83c169f2147" released by "delete_volume" :: held 0.619s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Created reservations ['5146631f-2053-48c2-ab9c-0441c36ddf5e', '8dddfcba-aa52-431d-bdee-c18b76df8268', '96f0531a-52c1-4b64-a0dd-5fe97392f9b8', '7dd088f4-5ee5-495c-a1ac-b3db4e93cc78'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:11 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:11 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:11 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.235s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Deleted volume successfully. Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ea3460eb-8710-4d5e-bcf5-8039e502d1f9 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-afcdc150-e0b7-4cb2-8832-d83c169f2147-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-b2cd25cc-1bea-40d8-ab33-c07043e0e53d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-b2cd25cc-1bea-40d8-ab33-c07043e0e53d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-quobyte-b2cd25cc-1bea-40d8-ab33-c07043e0e53d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-b2cd25cc-1bea-40d8-ab33-c07043e0e53d" acquired by "delete_volume" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c606c-d663-4a9b-b12a-e6e2332fc35b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:11 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d Sep 12 07:32:11 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:11 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d" returned: 0 in 0.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:11 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d Sep 12 07:32:11 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:12 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b2cd25cc-1bea-40d8-ab33-c07043e0e53d" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-b2cd25cc-1bea-40d8-ab33-c07043e0e53d" released by "delete_volume" :: held 0.627s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Created reservations ['5373cce4-65cd-4591-84ba-6f1abbbd6783', 'b067187e-8282-43c4-9c7e-2d20551f2a3a', '4c40f97c-383a-4db7-b273-dfdf665e92a5', 'e6f02ea4-2fbb-464a-a4ad-ccd836bb23de'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:12 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:12 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:12 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.230s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Deleted volume successfully. Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-01b1b9ed-2219-4460-8a37-79b36a9c55da tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-b2cd25cc-1bea-40d8-ab33-c07043e0e53d-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-quobyte-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f69efa-1f05-4381-8795-e93921601d3c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:12 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 Sep 12 07:32:12 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:13 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64" returned: 0 in 0.361s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:13 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64 Sep 12 07:32:13 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:13 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64" released by "delete_volume" :: held 0.640s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Created reservations ['1ccb7918-91ad-4a4f-bb68-67a01f666569', '13b916f6-d8e8-4206-950b-b928668b68ca', '4b50cf62-09ae-4ec6-881a-f6f09b256119', '8a39384a-b27c-4e7b-bcbb-d5d8edfc9ed5'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:13 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:13 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:13 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.235s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Deleted volume successfully. Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-09af6eb7-4a20-4cce-b07b-4a5f1043ec6a tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-9dd945ba-7ef7-4b46-bcf9-47a2a7aa8c64-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-bb428b0c-69df-4459-9438-c9d046dc8674-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-bb428b0c-69df-4459-9438-c9d046dc8674-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "cinder-quobyte-bb428b0c-69df-4459-9438-c9d046dc8674" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-bb428b0c-69df-4459-9438-c9d046dc8674" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[447693e1-9493-4c96-8220-c8d04d78972d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:13 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 Sep 12 07:32:13 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:14 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:14 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674 Sep 12 07:32:14 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:14 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bb428b0c-69df-4459-9438-c9d046dc8674" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-quobyte-bb428b0c-69df-4459-9438-c9d046dc8674" released by "delete_volume" :: held 0.621s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Created reservations ['3bcc7292-e881-47f1-bd46-17691a2f0ca8', '8e6ba6fd-7854-4378-9d4f-0315c1af42e5', '4ba6469b-9ac3-4c45-b8f9-cba8da9dc1e5', '19a82171-2354-41a5-90d2-07f92c84b8a8'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:14 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:14 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:14 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Deleted volume successfully. Sep 12 07:32:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e532a600-1317-4a55-8c8e-3729955ed901 tempest-CreateVolumesFromImageTest-1352397235 None] Lock "cinder-bb428b0c-69df-4459-9438-c9d046dc8674-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (ab5c917d-32f3-47b9-b3eb-e851681da63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66eed509-440a-4b03-8138-d0d6ec48cc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66eed509-440a-4b03-8138-d0d6ec48cc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107815793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839276bf-372b-4ef4-890d-734160391538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:17Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cc0749-9d20-45c6-bfa5-e079623fce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cc0749-9d20-45c6-bfa5-e079623fce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f920e8-65d9-4e4e-84dc-6cfcb908913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f920e8-65d9-4e4e-84dc-6cfcb908913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839276bf-372b-4ef4-890d-734160391538', 'volume_name': 'volume-839276bf-372b-4ef4-890d-734160391538', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd8ff19-da5a-4ab8-9eba-e34f11add0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd8ff19-da5a-4ab8-9eba-e34f11add0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba86801-52c4-43fd-993b-08ae976d46b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:17 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume 839276bf-372b-4ef4-890d-734160391538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839276bf-372b-4ef4-890d-734160391538', 'volume_size': 1} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107815793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839276bf-372b-4ef4-890d-734160391538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:17Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Creating volume 839276bf-372b-4ef4-890d-734160391538 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:17 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:17 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 1073741824 Sep 12 07:32:17 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:17 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 1073741824" returned: 0 in 0.384s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:18 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 Sep 12 07:32:18 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:18 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba86801-52c4-43fd-993b-08ae976d46b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839276bf-372b-4ef4-890d-734160391538', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01188c-99da-4b2a-8de5-0c7a0857da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume volume-839276bf-372b-4ef4-890d-734160391538 (839276bf-372b-4ef4-890d-734160391538): created successfully Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01188c-99da-4b2a-8de5-0c7a0857da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (ab5c917d-32f3-47b9-b3eb-e851681da63a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-46adeefe-8d67-483a-ada9-b24bd3f13291 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created volume successfully. Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (5e39bb90-fa02-4c7c-9bc6-ec60fdbd4efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2eb85fb-6f55-4f08-ab15-1d24050f49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2eb85fb-6f55-4f08-ab15-1d24050f49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1624028727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e808ef-76b4-454e-b3de-0311264648b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:19Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77688f8b-cab9-42ec-891f-880799ffac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77688f8b-cab9-42ec-891f-880799ffac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faffa447-439e-4831-934a-5dffa0922054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faffa447-439e-4831-934a-5dffa0922054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e808ef-76b4-454e-b3de-0311264648b6', 'volume_name': 'volume-14e808ef-76b4-454e-b3de-0311264648b6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b13307-79bb-4ca1-bc6b-967278fdd151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b13307-79bb-4ca1-bc6b-967278fdd151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938b8cfc-13c7-4ff3-aef5-1aad667e3cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume 14e808ef-76b4-454e-b3de-0311264648b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e808ef-76b4-454e-b3de-0311264648b6', 'volume_size': 1} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1624028727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e808ef-76b4-454e-b3de-0311264648b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:19Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Creating volume 14e808ef-76b4-454e-b3de-0311264648b6 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:19 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 1073741824 Sep 12 07:32:19 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (86956223-7c21-4298-9478-8a5eabd0fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fca71a-97e3-422f-8a22-4c6ad20e5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fca71a-97e3-422f-8a22-4c6ad20e5143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-12614883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eedeba-9ad5-4fdc-860b-ef014fef2b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:19Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf5d125-1119-4efe-a098-13f0c2afae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf5d125-1119-4efe-a098-13f0c2afae00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795dc1d7-86d5-4a30-a080-1c4e3e4e4ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795dc1d7-86d5-4a30-a080-1c4e3e4e4ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10eedeba-9ad5-4fdc-860b-ef014fef2b94', 'volume_name': 'volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f180b6-a888-46d1-8d85-ec0518d54e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f180b6-a888-46d1-8d85-ec0518d54e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20d1bb2-64d9-4787-a818-2e30eb44b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume 10eedeba-9ad5-4fdc-860b-ef014fef2b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94', 'volume_size': 1} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:19 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 1073741824" returned: 0 in 0.492s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:19 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 Sep 12 07:32:19 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (8c1f9f0b-68df-4b77-b5e4-e801f9ba171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca79490-c62d-4bde-af5b-56d9bfc6f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca79490-c62d-4bde-af5b-56d9bfc6f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104347013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bba582d-98e4-40cb-8d03-7f6da2a577bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:20Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaaf19e-3fd5-4dc7-b521-2276a7f0078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaaf19e-3fd5-4dc7-b521-2276a7f0078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03072c62-9c5a-485e-bb08-0e44652e2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03072c62-9c5a-485e-bb08-0e44652e2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bba582d-98e4-40cb-8d03-7f6da2a577bf', 'volume_name': 'volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a2708-ce52-4eec-a261-5eb8068cac02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a2708-ce52-4eec-a261-5eb8068cac02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c430e3-b4b9-4adb-a24f-ec00d6362afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume 6bba582d-98e4-40cb-8d03-7f6da2a577bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf', 'volume_size': 1} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:19 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6" returned: 0 in 0.272s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-12614883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eedeba-9ad5-4fdc-860b-ef014fef2b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:19Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Creating volume 10eedeba-9ad5-4fdc-860b-ef014fef2b94 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938b8cfc-13c7-4ff3-aef5-1aad667e3cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e808ef-76b4-454e-b3de-0311264648b6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 1073741824 Sep 12 07:32:19 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4ac4ea-0577-4aaf-ab86-006caf600d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume volume-14e808ef-76b4-454e-b3de-0311264648b6 (14e808ef-76b4-454e-b3de-0311264648b6): created successfully Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4ac4ea-0577-4aaf-ab86-006caf600d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:19 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (5e39bb90-fa02-4c7c-9bc6-ec60fdbd4efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-de8cef8c-0569-4e34-8853-c5adbabb9808 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created volume successfully. Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (3ad36d65-9e0f-4e7f-b315-a83916acea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4854ccde-0c7e-498e-981b-a23419bf068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4854ccde-0c7e-498e-981b-a23419bf068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-595468888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf169db7-b017-4d48-b3a4-ea4c588efd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:20Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa57653-6b7e-4c37-bbf1-41337bb8170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa57653-6b7e-4c37-bbf1-41337bb8170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16eb5971-073c-45b6-aa20-606da33e82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16eb5971-073c-45b6-aa20-606da33e82b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf169db7-b017-4d48-b3a4-ea4c588efd4a', 'volume_name': 'volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d144dd7c-f59d-4434-bad2-d7c38d9c99fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d144dd7c-f59d-4434-bad2-d7c38d9c99fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cd439a-46c4-48d6-a32c-742254188792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume bf169db7-b017-4d48-b3a4-ea4c588efd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a', 'volume_size': 1} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:20 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 1073741824" returned: 0 in 0.473s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:20 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 Sep 12 07:32:20 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (34d6d7aa-b522-4038-a8c9-a3707e6d87d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9448494-bfb3-4edf-95c6-7c8a128bf578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9448494-bfb3-4edf-95c6-7c8a128bf578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-341594483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:20Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96aa4a5-6518-4591-96f2-0f57e284b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96aa4a5-6518-4591-96f2-0f57e284b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800b972b-fb7d-4d1c-87b7-6889171a7dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800b972b-fb7d-4d1c-87b7-6889171a7dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3', 'volume_name': 'volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e614c06-92fa-4e9d-9c6c-5461b09fc3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e614c06-92fa-4e9d-9c6c-5461b09fc3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac1c33-a73f-4250-876c-c32ea88cf65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume 2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3', 'volume_size': 1} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:20 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.895s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104347013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bba582d-98e4-40cb-8d03-7f6da2a577bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:20Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Creating volume 6bba582d-98e4-40cb-8d03-7f6da2a577bf {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:20 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:20 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf 1073741824 Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20d1bb2-64d9-4787-a818-2e30eb44b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c72e867-3948-4d95-802f-e5cb5e20b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:20 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 (10eedeba-9ad5-4fdc-860b-ef014fef2b94): created successfully Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c72e867-3948-4d95-802f-e5cb5e20b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:20 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (86956223-7c21-4298-9478-8a5eabd0fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f44dc8b6-2817-4b68-9c96-83d3a27767c1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created volume successfully. Sep 12 07:32:20 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf 1073741824" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:21 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf Sep 12 07:32:21 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:21 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-595468888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf169db7-b017-4d48-b3a4-ea4c588efd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:20Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Creating volume bf169db7-b017-4d48-b3a4-ea4c588efd4a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:21 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c430e3-b4b9-4adb-a24f-ec00d6362afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:21 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a 1073741824 Sep 12 07:32:21 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ee69a1-80ec-47f5-b6af-30b34e1ba6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:21 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf (6bba582d-98e4-40cb-8d03-7f6da2a577bf): created successfully Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ee69a1-80ec-47f5-b6af-30b34e1ba6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (8c1f9f0b-68df-4b77-b5e4-e801f9ba171e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1e4fa6df-6735-42ce-a79f-33e5b865dbb0 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created volume successfully. Sep 12 07:32:21 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a 1073741824" returned: 0 in 0.406s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:21 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a Sep 12 07:32:21 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:21 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-341594483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bcc2d2406f46faadf711a85d1bcd9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:20Z,use_quota=True,user_id='8039e95336a84db9b5f68d02e4abfa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Creating volume 2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:21 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:21 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cd439a-46c4-48d6-a32c-742254188792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:22 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 1073741824 Sep 12 07:32:22 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2c9c2-19db-49cd-9f1b-519960dd74bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a (bf169db7-b017-4d48-b3a4-ea4c588efd4a): created successfully Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2c9c2-19db-49cd-9f1b-519960dd74bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (3ad36d65-9e0f-4e7f-b315-a83916acea20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-77c9f8fe-6a47-410a-9634-d8c2a80d251e tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created volume successfully. Sep 12 07:32:22 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 1073741824" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:22 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 Sep 12 07:32:22 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:22 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac1c33-a73f-4250-876c-c32ea88cf65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182b6478-116a-416b-bf3e-2924cc1a53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Volume volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 (2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3): created successfully Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182b6478-116a-416b-bf3e-2924cc1a53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Flow 'volume_create_manager' (34d6d7aa-b522-4038-a8c9-a3707e6d87d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d3cba735-1bb2-45f2-a5cb-9b23c790a6de tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created volume successfully. Sep 12 07:32:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-quobyte-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:23 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692c27c-8cdc-492b-bb43-a6e6577bb124]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:23 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 Sep 12 07:32:23 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:24 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3" returned: 0 in 0.361s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:24 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3 Sep 12 07:32:24 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:24 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3" released by "delete_volume" :: held 0.638s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created reservations ['ccd57b85-ce21-4ca2-b4cd-43bdb3143f0f', 'ea5ac6c9-9f5d-4c93-9aff-9cae982e9c82', 'c17917c5-191d-4249-ba3f-756d07d8e18d', 'c614eae0-94d1-4d3f-aaa2-8adea8e85f43'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:24 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:24 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:24 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:24 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Deleted volume successfully. Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2f3e5aa3-40e7-4160-a8c7-4371e6efd6e5 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-2f4ac3bc-5e7d-4144-ae9b-0c8f41ca55d3-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-bf169db7-b017-4d48-b3a4-ea4c588efd4a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-bf169db7-b017-4d48-b3a4-ea4c588efd4a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:24 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-quobyte-bf169db7-b017-4d48-b3a4-ea4c588efd4a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-bf169db7-b017-4d48-b3a4-ea4c588efd4a" acquired by "delete_volume" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[18391cfe-8d72-42b2-8c06-6d1b76bf4f47]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:25 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a Sep 12 07:32:25 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:25 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:25 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a Sep 12 07:32:25 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:25 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-bf169db7-b017-4d48-b3a4-ea4c588efd4a" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-bf169db7-b017-4d48-b3a4-ea4c588efd4a" released by "delete_volume" :: held 0.631s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created reservations ['7d2d1044-db2a-4a76-be01-45bb697bf0d4', 'd4e7cb32-1289-4de7-9889-23dca8aa490f', '24a387dc-8af3-4cd7-8295-2cf0d009bedc', '8e14efd4-0030-4e14-b9dc-9d8ef8798b8c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:25 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:25 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:25 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.236s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:25 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Deleted volume successfully. Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c9761c5-0e93-41a9-8a9f-87373e077e0f tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-bf169db7-b017-4d48-b3a4-ea4c588efd4a-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-6bba582d-98e4-40cb-8d03-7f6da2a577bf-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-6bba582d-98e4-40cb-8d03-7f6da2a577bf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-quobyte-6bba582d-98e4-40cb-8d03-7f6da2a577bf" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-6bba582d-98e4-40cb-8d03-7f6da2a577bf" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1890a613-d978-4bd9-a6d4-bc9897f64d77]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:26 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf Sep 12 07:32:26 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:26 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf" returned: 0 in 0.343s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:26 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf Sep 12 07:32:26 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:26 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6bba582d-98e4-40cb-8d03-7f6da2a577bf" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-6bba582d-98e4-40cb-8d03-7f6da2a577bf" released by "delete_volume" :: held 0.618s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created reservations ['f885ad82-182f-4405-bae6-320616b42f03', 'c381151a-704c-4206-9c45-8ceaee7abaaa', '78906a9c-272f-412c-9a13-ff05ad6986b1', '80c4037b-0261-4b62-b240-ee5ccb9f4c2e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:26 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:26 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:27 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Deleted volume successfully. Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-99d7022d-6f1d-4160-95d4-3f8a775b92d1 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-6bba582d-98e4-40cb-8d03-7f6da2a577bf-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-10eedeba-9ad5-4fdc-860b-ef014fef2b94-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-10eedeba-9ad5-4fdc-860b-ef014fef2b94-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-quobyte-10eedeba-9ad5-4fdc-860b-ef014fef2b94" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-10eedeba-9ad5-4fdc-860b-ef014fef2b94" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e5b95-f94f-41db-a601-07c361e8c3bd]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:27 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 Sep 12 07:32:27 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:27 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94" returned: 0 in 0.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:27 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94 Sep 12 07:32:27 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:27 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-10eedeba-9ad5-4fdc-860b-ef014fef2b94" returned: 0 in 0.236s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-10eedeba-9ad5-4fdc-860b-ef014fef2b94" released by "delete_volume" :: held 0.618s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:27 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created reservations ['5bd8f471-9a26-4f49-b291-cca32728aa3d', '84b52aa0-ad2c-478f-a7fe-9b39d7819a69', '47433078-a525-451c-9885-de4dd322fe9c', 'e8e86b83-4e67-440a-bd37-71d647e5174f'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:28 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:28 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:28 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.233s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Deleted volume successfully. Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eadb6c7a-56ea-4100-a855-1195a9e74a91 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-10eedeba-9ad5-4fdc-860b-ef014fef2b94-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-14e808ef-76b4-454e-b3de-0311264648b6-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-14e808ef-76b4-454e-b3de-0311264648b6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-quobyte-14e808ef-76b4-454e-b3de-0311264648b6" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-14e808ef-76b4-454e-b3de-0311264648b6" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5765f982-077c-4291-95d1-061c03a4444b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:28 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 Sep 12 07:32:28 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:28 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:28 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6 Sep 12 07:32:28 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:29 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-14e808ef-76b4-454e-b3de-0311264648b6" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-14e808ef-76b4-454e-b3de-0311264648b6" released by "delete_volume" :: held 0.633s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created reservations ['70b89f44-d3b8-44f2-a631-3101ab5f3d6f', '1cf42d48-af98-48a6-aaeb-c0574764c6ea', '41a24da2-d970-4edd-8b19-deb01bee49c6', 'b0a668d8-51ed-49ba-bd13-7bb27047a72e'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:29 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:29 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:29 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.234s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Deleted volume successfully. Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5183a6c9-956e-4ea3-979f-54d4143d2a61 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-14e808ef-76b4-454e-b3de-0311264648b6-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-839276bf-372b-4ef4-890d-734160391538-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-839276bf-372b-4ef4-890d-734160391538-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "cinder-quobyte-839276bf-372b-4ef4-890d-734160391538" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-839276bf-372b-4ef4-890d-734160391538" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2ca7c-c442-4271-b0ad-6dffabc34540]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:29 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 Sep 12 07:32:29 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:29 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:29 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538 Sep 12 07:32:29 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:30 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-839276bf-372b-4ef4-890d-734160391538" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-quobyte-839276bf-372b-4ef4-890d-734160391538" released by "delete_volume" :: held 0.625s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Created reservations ['4ca1dae5-d21a-47a2-9818-a8ead4a78761', '67146fb8-7da8-4db0-9deb-a0b2c8368e6c', 'ce1e31a9-2810-4ef6-b624-0600d71e75be', 'ea483d93-1329-4b52-8165-8d875ba60f07'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:30 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:30 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:30 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:30 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:30 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Deleted volume successfully. Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d6b3b59f-e08c-4822-9fca-0645b97dadd3 tempest-CreateVolumesFromSourceVolumeTest-1459750855 None] Lock "cinder-839276bf-372b-4ef4-890d-734160391538-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:30 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:32:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (dd26c9e8-64e6-4e76-8729-88a30e028d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed73c300-8d46-42f8-bce6-e9cbe014335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed73c300-8d46-42f8-bce6-e9cbe014335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-140037547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bd6080-d34b-4baf-bcd0-135ebc3ffbec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:42Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544a1050-abd2-43de-999f-b4933a7e1349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544a1050-abd2-43de-999f-b4933a7e1349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc711f9-e582-44de-a21b-535126510655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc711f9-e582-44de-a21b-535126510655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bd6080-d34b-4baf-bcd0-135ebc3ffbec', 'volume_name': 'volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef08516-14bc-4782-8ca2-767856ff13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef08516-14bc-4782-8ca2-767856ff13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7901ca96-aa34-45c4-a010-9188b650d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:42 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Volume b7bd6080-d34b-4baf-bcd0-135ebc3ffbec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec', 'volume_size': 1} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-140037547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bd6080-d34b-4baf-bcd0-135ebc3ffbec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:42Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Creating volume b7bd6080-d34b-4baf-bcd0-135ebc3ffbec {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:42 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:42 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec 1073741824 Sep 12 07:32:42 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:42 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:42 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (e6ac83af-0978-4d67-a82f-0450f0559fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744e95b1-2d59-423f-bee9-d9511b9ac691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec 1073741824" returned: 0 in 0.734s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744e95b1-2d59-423f-bee9-d9511b9ac691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1695089998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a89397f-7d43-48ee-ab8b-0e428b7493b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ce47bd-6f7d-4f00-b042-fae1121de1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ce47bd-6f7d-4f00-b042-fae1121de1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4558b87c-8de9-4679-a47a-fa366ff1d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4558b87c-8de9-4679-a47a-fa366ff1d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a89397f-7d43-48ee-ab8b-0e428b7493b7', 'volume_name': 'volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d5303c-351d-4673-a401-77f9ed202b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d5303c-351d-4673-a401-77f9ed202b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f81be2-398f-47dc-9c73-90a9f8a30e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume 5a89397f-7d43-48ee-ab8b-0e428b7493b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7', 'volume_size': 1} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (c3352b08-e9b7-441d-a6af-2b7bbf9cf952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bf59eb-f5c9-4673-bba7-f15522205dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bf59eb-f5c9-4673-bba7-f15522205dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485691903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4c9959-64bf-44a8-a649-c45b9c542a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9510f1-c9c3-4edc-b4be-a01f10a9ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9510f1-c9c3-4edc-b4be-a01f10a9ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2fa82c-6b59-4e3d-bceb-fd135e6a6d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2fa82c-6b59-4e3d-bceb-fd135e6a6d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4c9959-64bf-44a8-a649-c45b9c542a2d', 'volume_name': 'volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2208ae5-2c83-4823-8659-5e7c23f9f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2208ae5-2c83-4823-8659-5e7c23f9f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0531f07a-23eb-47a1-8f43-f2fff62665d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Volume cb4c9959-64bf-44a8-a649-c45b9c542a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d', 'volume_size': 1} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:43 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec Sep 12 07:32:43 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (a716e433-90b5-4e12-9b1e-caad5d3fda8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bb7c17-fbdd-4a04-b7ba-734ed89e6061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bb7c17-fbdd-4a04-b7ba-734ed89e6061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833953929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7cc08c-590d-4b33-a735-9a6c0d65c334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664db8c1-3af8-49d2-b2f0-442324d99472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664db8c1-3af8-49d2-b2f0-442324d99472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7a7f56-d4ff-4fe0-9b03-01a695bc4381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7a7f56-d4ff-4fe0-9b03-01a695bc4381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7cc08c-590d-4b33-a735-9a6c0d65c334', 'volume_name': 'volume-df7cc08c-590d-4b33-a735-9a6c0d65c334', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ecd78d-8c7e-4b61-b7f3-e3483a99b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ecd78d-8c7e-4b61-b7f3-e3483a99b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ff8a9b-c6f5-459a-8ad2-c5ccb6031f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Volume df7cc08c-590d-4b33-a735-9a6c0d65c334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7cc08c-590d-4b33-a735-9a6c0d65c334', 'volume_size': 1} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (6e7dd277-1e24-4398-8c30-252cfd8486ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb801441-5ac2-47de-8805-9327a0a2f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb801441-5ac2-47de-8805-9327a0a2f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2113787521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf237d-e542-4135-8284-ca7ab36342e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d6fb55-da1b-4111-a3a6-a6cf20a2d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d6fb55-da1b-4111-a3a6-a6cf20a2d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1603c1d9-6f71-4a54-a210-23cb9cbc354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1603c1d9-6f71-4a54-a210-23cb9cbc354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaf237d-e542-4135-8284-ca7ab36342e4', 'volume_name': 'volume-0eaf237d-e542-4135-8284-ca7ab36342e4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9a6787-1dfc-473d-b68f-776bed35f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9a6787-1dfc-473d-b68f-776bed35f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b6bd9d-dd8f-4400-9d4d-4dd0338ddcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Volume 0eaf237d-e542-4135-8284-ca7ab36342e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaf237d-e542-4135-8284-ca7ab36342e4', 'volume_size': 1} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec" returned: 0 in 0.424s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1695089998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a89397f-7d43-48ee-ab8b-0e428b7493b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Creating volume 5a89397f-7d43-48ee-ab8b-0e428b7493b7 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7901ca96-aa34-45c4-a010-9188b650d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 1073741824 Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1662098b-29cf-4d7d-bc66-4d0d43629408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Volume volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec (b7bd6080-d34b-4baf-bcd0-135ebc3ffbec): created successfully Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1662098b-29cf-4d7d-bc66-4d0d43629408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (dd26c9e8-64e6-4e76-8729-88a30e028d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:43 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3264cede-6397-4a74-a2d0-4d3924735036 tempest-CreateVolumesFromImageTest-316246253 None] Created volume successfully. Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (e7a0f276-d06b-4da3-aa85-c68afb324151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6eebed0-017e-4c6b-a605-9c550d4a54b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6eebed0-017e-4c6b-a605-9c550d4a54b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1318645343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7daa16c-a3cd-4faf-8d86-b85a1b465ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:44Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc0170b-e970-4e8b-b7c5-272b3192e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc0170b-e970-4e8b-b7c5-272b3192e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9887ac89-5997-47a0-90ab-dbadf3ee2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9887ac89-5997-47a0-90ab-dbadf3ee2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7daa16c-a3cd-4faf-8d86-b85a1b465ea1', 'volume_name': 'volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:43 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3efa35-427a-41e2-9573-d16d34531af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3efa35-427a-41e2-9573-d16d34531af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50d21c2-0c23-4ca7-9744-dd4df1b44ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Volume f7daa16c-a3cd-4faf-8d86-b85a1b465ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1', 'volume_size': 1} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:44 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 1073741824" returned: 0 in 0.556s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:44 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 Sep 12 07:32:44 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:44 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.307s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485691903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4c9959-64bf-44a8-a649-c45b9c542a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Creating volume cb4c9959-64bf-44a8-a649-c45b9c542a2d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:44 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f81be2-398f-47dc-9c73-90a9f8a30e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ca1d01-90f5-47ba-9d24-e6f9ed426941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:44 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d 1073741824 Sep 12 07:32:44 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 (5a89397f-7d43-48ee-ab8b-0e428b7493b7): created successfully Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ca1d01-90f5-47ba-9d24-e6f9ed426941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (e6ac83af-0978-4d67-a82f-0450f0559fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cfd56609-6488-4fd3-9f42-1effdc2e68d1 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created volume successfully. Sep 12 07:32:45 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d 1073741824" returned: 0 in 0.519s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:45 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d Sep 12 07:32:45 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Flow 'volume_create_manager' (360cad8e-40db-449a-a684-8ec4eb1eff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:45 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e6a0b7-5c55-4bdd-8732-abe7daa91172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.965s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833953929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7cc08c-590d-4b33-a735-9a6c0d65c334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Creating volume df7cc08c-590d-4b33-a735-9a6c0d65c334 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:45 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e6a0b7-5c55-4bdd-8732-abe7daa91172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3494d894-4039-40b9-b5a5-2066a008d15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1fe093fe1b49429cd5847887b6cfc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:45Z,use_quota=True,user_id='24378c97ff2a45b298102350e2cb8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01aab88-9352-4000-aaf6-2ce56f1e4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:45 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 1073741824 Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01aab88-9352-4000-aaf6-2ce56f1e4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:45 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a028a13-6b5e-4643-862a-a1da9d8298db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0531f07a-23eb-47a1-8f43-f2fff62665d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7587b8-7aa5-47e5-a75f-673993225401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:45 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Volume volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d (cb4c9959-64bf-44a8-a649-c45b9c542a2d): created successfully Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7587b8-7aa5-47e5-a75f-673993225401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (c3352b08-e9b7-441d-a6af-2b7bbf9cf952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:45 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b63ea8bd-27c8-4586-a425-1b2b0edc10ef tempest-CreateVolumesFromImageTest-316246253 None] Created volume successfully. Sep 12 07:32:45 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a028a13-6b5e-4643-862a-a1da9d8298db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3494d894-4039-40b9-b5a5-2066a008d15d', 'volume_name': 'volume-3494d894-4039-40b9-b5a5-2066a008d15d', 'volume_size': 1, 'image_id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/520c4c95-e2c0-4f64-955a-07fa32a203bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9aebfa8bc2747a774c87da2b3a308371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b1fe093fe1b49429cd5847887b6cfc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3609d8923be7b907bbc835b5c71f4af798c9c1925afdf5a90e7e0aa6f67cf8689dc2bdbc2184fd32da5668a53780952ef2dbf3e5ef4ed078a7ab270fae20678', 'id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'created_at': datetime.datetime(2026, 9, 12, 5, 32, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 32, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/520c4c95-e2c0-4f64-955a-07fa32a203bf/file', 'properties': {}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4954ff3-14a5-4377-b086-620a906c1754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4954ff3-14a5-4377-b086-620a906c1754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d0c088-70a9-41de-bff2-60a653773c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Volume 3494d894-4039-40b9-b5a5-2066a008d15d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3494d894-4039-40b9-b5a5-2066a008d15d', 'volume_size': 1, 'image_id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/520c4c95-e2c0-4f64-955a-07fa32a203bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9aebfa8bc2747a774c87da2b3a308371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b1fe093fe1b49429cd5847887b6cfc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3609d8923be7b907bbc835b5c71f4af798c9c1925afdf5a90e7e0aa6f67cf8689dc2bdbc2184fd32da5668a53780952ef2dbf3e5ef4ed078a7ab270fae20678', 'id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'created_at': datetime.datetime(2026, 9, 12, 5, 32, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 32, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/520c4c95-e2c0-4f64-955a-07fa32a203bf/file', 'properties': {}}, 'image_service': } Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Trying to clone 3494d894-4039-40b9-b5a5-2066a008d15d from image 520c4c95-e2c0-4f64-955a-07fa32a203bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/520c4c95-e2c0-4f64-955a-07fa32a203bf', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (3a6bab2d-e829-469e-8b16-54e601ac561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a087b391-c953-4c04-830e-fcf75f71d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a087b391-c953-4c04-830e-fcf75f71d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852262838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89ae35f-891f-4c3c-ba36-9237ec021440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:46Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58a9517-2f3a-4ec9-81d5-dd4938f25c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58a9517-2f3a-4ec9-81d5-dd4938f25c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692d94bd-2656-4a6a-aafe-ed557246ba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692d94bd-2656-4a6a-aafe-ed557246ba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89ae35f-891f-4c3c-ba36-9237ec021440', 'volume_name': 'volume-b89ae35f-891f-4c3c-ba36-9237ec021440', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dd1a91-a96b-41eb-a550-49d5770abe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dd1a91-a96b-41eb-a550-49d5770abe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5a7938-f90c-4a37-bf7c-eeb96e601b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume b89ae35f-891f-4c3c-ba36-9237ec021440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89ae35f-891f-4c3c-ba36-9237ec021440', 'volume_size': 1} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:32:46 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Image download 0.00 MB at 0.00 MB/s Sep 12 07:32:46 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 1073741824" returned: 0 in 0.679s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0067a8-d5d8-4bf0-abe0-3481d4c32c8a]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:46 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 Sep 12 07:32:46 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:46 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD Sep 12 07:32:46 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:46 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (068d8c38-760e-4a79-8935-45397d21791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:46 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8076ed1-3434-4589-b264-a47c0a15e9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334" returned: 0 in 0.481s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2113787521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf237d-e542-4135-8284-ca7ab36342e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:43Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Creating volume 0eaf237d-e542-4135-8284-ca7ab36342e4 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:46 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8076ed1-3434-4589-b264-a47c0a15e9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345538188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc5fefd-a0d9-4894-9b33-59f91b4d592f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:47Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3629a4b-296b-44c0-9eb0-f9945338509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 1073741824 Sep 12 07:32:46 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3629a4b-296b-44c0-9eb0-f9945338509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544c0445-2938-423c-806d-40646bdf451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544c0445-2938-423c-806d-40646bdf451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc5fefd-a0d9-4894-9b33-59f91b4d592f', 'volume_name': 'volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD Sep 12 07:32:46 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a18534-ac01-4771-9855-5dd80b824224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a18534-ac01-4771-9855-5dd80b824224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ca0af4-9993-4ac3-9cd8-d0ea539cf2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume cfc5fefd-a0d9-4894-9b33-59f91b4d592f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f', 'volume_size': 1} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ff8a9b-c6f5-459a-8ad2-c5ccb6031f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7cc08c-590d-4b33-a735-9a6c0d65c334', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d87753-6894-4e8b-abd9-14a335c46d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:46 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Volume volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 (df7cc08c-590d-4b33-a735-9a6c0d65c334): created successfully Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d87753-6894-4e8b-abd9-14a335c46d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:46 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (a716e433-90b5-4e12-9b1e-caad5d3fda8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Flow 'volume_create_manager' (744cbb11-90ec-4dff-a418-a26c156f077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b281bea9-32fa-4123-8a08-a6f2f542085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2012cbff-3cc8-445e-9f41-1d6cdc530c98 tempest-CreateVolumesFromImageTest-316246253 None] Created volume successfully. Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b281bea9-32fa-4123-8a08-a6f2f542085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30635906-9bbf-43ae-89ac-e587f16754c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be24bd9d2b748aca630052a1461ac30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:47Z,use_quota=True,user_id='c114ae201c1f48afa944c8411a593da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12961f75-5083-491f-9f34-68dec537f20b),volume_type_id=12961f75-5083-491f-9f34-68dec537f20b)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056eea1f-c781-4e79-acf4-7a7d9c8c3534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056eea1f-c781-4e79-acf4-7a7d9c8c3534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565363b8-659a-4e82-b51b-878b279f9aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.image.glance [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Creating Keystone auth plugin from conf {{(pid=88013) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (5e0117c8-116e-4157-91f7-2687af01f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18583ea-4f78-44bb-8744-b46ce7be7135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18583ea-4f78-44bb-8744-b46ce7be7135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431595651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471ba6da-b113-4444-8a1d-c3d331b301fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:47Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfaaf73-a47c-4700-9096-6116c1a0ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfaaf73-a47c-4700-9096-6116c1a0ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5e162e-9c41-4ba8-b3ee-e659551ca0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5e162e-9c41-4ba8-b3ee-e659551ca0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471ba6da-b113-4444-8a1d-c3d331b301fe', 'volume_name': 'volume-471ba6da-b113-4444-8a1d-c3d331b301fe', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a84d1fe-ff67-4cee-86ba-67b22e99c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a84d1fe-ff67-4cee-86ba-67b22e99c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bae1b6c-8bfb-4204-9a7a-e40a938f074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume 471ba6da-b113-4444-8a1d-c3d331b301fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471ba6da-b113-4444-8a1d-c3d331b301fe', 'volume_size': 1} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD" returned: 1 in 0.575s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Temporary image 520c4c95-e2c0-4f64-955a-07fa32a203bf is fetched for user 24378c97ff2a45b298102350e2cb8b21. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72b9b9-a16e-4d13-b477-60439160d9d8]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:47 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 1073741824" returned: 0 in 0.654s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565363b8-659a-4e82-b51b-878b279f9aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30635906-9bbf-43ae-89ac-e587f16754c9', 'volume_name': 'volume-30635906-9bbf-43ae-89ac-e587f16754c9', 'volume_size': 1, 'image_id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/abab0820-869b-427e-9a09-9694a27a43ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90b2434d0d156c1d33d52c948a6d2632', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7be24bd9d2b748aca630052a1461ac30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1157aabd236d5221b1ec17edffe0c7faaf10e221c290c7fc4ebcb33d97b7e7fb29988bbced68574f88ebc8cf8623f3bc42a929cdb3a215dda0bef7019b5cf54e', 'id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'created_at': datetime.datetime(2026, 9, 12, 5, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/abab0820-869b-427e-9a09-9694a27a43ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff5588d-00b2-41b6-8a59-be489260cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff5588d-00b2-41b6-8a59-be489260cca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD Sep 12 07:32:47 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945c061f-f580-4fd9-9b43-d1aa126ac422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Volume 30635906-9bbf-43ae-89ac-e587f16754c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30635906-9bbf-43ae-89ac-e587f16754c9', 'volume_size': 1, 'image_id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/abab0820-869b-427e-9a09-9694a27a43ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90b2434d0d156c1d33d52c948a6d2632', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7be24bd9d2b748aca630052a1461ac30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1157aabd236d5221b1ec17edffe0c7faaf10e221c290c7fc4ebcb33d97b7e7fb29988bbced68574f88ebc8cf8623f3bc42a929cdb3a215dda0bef7019b5cf54e', 'id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'created_at': datetime.datetime(2026, 9, 12, 5, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/abab0820-869b-427e-9a09-9694a27a43ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Trying to clone 30635906-9bbf-43ae-89ac-e587f16754c9 from image abab0820-869b-427e-9a09-9694a27a43ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/abab0820-869b-427e-9a09-9694a27a43ff', 'metadata': {}}]). {{(pid=88013) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:47 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 Sep 12 07:32:47 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Image download 0.00 MB at 0.00 MB/s Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (936e2d2e-06e4-4af0-ad97-17749fd579c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322537b2-21d1-4631-94f8-7cf4b1e35b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322537b2-21d1-4631-94f8-7cf4b1e35b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643505698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe48f86-f211-4eb3-9a83-6ca90409c4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:48Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d886310-22c3-49e3-a831-d8e537f6c59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d886310-22c3-49e3-a831-d8e537f6c59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab945cbe-5579-490e-bc6c-b7c7d3152dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab945cbe-5579-490e-bc6c-b7c7d3152dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe48f86-f211-4eb3-9a83-6ca90409c4b0', 'volume_name': 'volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e153a066-1515-4bad-9af8-a603df2de306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e153a066-1515-4bad-9af8-a603df2de306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78c3aba-e28b-437f-9b57-0b7915489adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume 0fe48f86-f211-4eb3-9a83-6ca90409c4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0', 'volume_size': 1} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:47 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709eb6a-43e5-4fb8-a518-7ecb88b71afe]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4" returned: 0 in 0.371s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.887s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1318645343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7daa16c-a3cd-4faf-8d86-b85a1b465ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f144d2c03d4e35be30c06ae5fb56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:44Z,use_quota=True,user_id='c3dadea443744e2094631270033c2b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Creating volume f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b6bd9d-dd8f-4400-9d4d-4dd0338ddcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaf237d-e542-4135-8284-ca7ab36342e4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:47 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 1073741824 Sep 12 07:32:47 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58315926-e52b-42d4-a37d-f417c3b30a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:47 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Volume volume-0eaf237d-e542-4135-8284-ca7ab36342e4 (0eaf237d-e542-4135-8284-ca7ab36342e4): created successfully Sep 12 07:32:47 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD Sep 12 07:32:47 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:47 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58315926-e52b-42d4-a37d-f417c3b30a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (6e7dd277-1e24-4398-8c30-252cfd8486ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-12072d55-8479-4fe7-829d-b227b5c99165 tempest-CreateVolumesFromImageTest-316246253 None] Created volume successfully. Sep 12 07:32:48 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD Sep 12 07:32:48 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:48 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (e92c434f-cc5b-43cd-8c94-0f517cd143c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67e655-9c59-410e-b032-5d564ba086f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67e655-9c59-410e-b032-5d564ba086f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2086750955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5351445c-d824-45b4-8029-27b6ce615da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:48Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f15ec0-ced8-42f1-9e76-e022836dd4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f15ec0-ced8-42f1-9e76-e022836dd4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48062e0-26e5-4bb0-9a96-6f7c19098598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48062e0-26e5-4bb0-9a96-6f7c19098598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5351445c-d824-45b4-8029-27b6ce615da6', 'volume_name': 'volume-5351445c-d824-45b4-8029-27b6ce615da6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e87276-4466-4de8-b6c0-230c51a7fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e87276-4466-4de8-b6c0-230c51a7fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e53f3a-1133-4799-bfdd-621abcad5025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume 5351445c-d824-45b4-8029-27b6ce615da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5351445c-d824-45b4-8029-27b6ce615da6', 'volume_size': 1} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:48 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 1073741824" returned: 0 in 0.527s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:48 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD Sep 12 07:32:48 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:48 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 Sep 12 07:32:48 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:48 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Temporary image abab0820-869b-427e-9a09-9694a27a43ff is fetched for user c114ae201c1f48afa944c8411a593da7. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 12 07:32:48 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.568s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852262838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89ae35f-891f-4c3c-ba36-9237ec021440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:46Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Creating volume b89ae35f-891f-4c3c-ba36-9237ec021440 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:48 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:48 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 1073741824 Sep 12 07:32:48 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50d21c2-0c23-4ca7-9744-dd4df1b44ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c1f57e-d4f8-4b49-a75f-fef9f26fc9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:48 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Volume volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 (f7daa16c-a3cd-4faf-8d86-b85a1b465ea1): created successfully Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c1f57e-d4f8-4b49-a75f-fef9f26fc9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Flow 'volume_create_manager' (e7a0f276-d06b-4da3-aa85-c68afb324151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a5317-00d4-4c8f-8e6c-11bef8331859]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1713adb3-828b-43ab-ad54-79d2a50e46d9 tempest-CreateVolumesFromImageTest-316246253 None] Created volume successfully. Sep 12 07:32:48 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD Sep 12 07:32:48 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:49 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:49 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 1073741824" returned: 0 in 0.502s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-quobyte-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:49 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD Sep 12 07:32:49 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9481aa8-e21d-4910-becc-fdc3e69941bf]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:49 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 Sep 12 07:32:49 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:49 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 Sep 12 07:32:49 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:49 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:49 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.667s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345538188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc5fefd-a0d9-4894-9b33-59f91b4d592f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:47Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Creating volume cfc5fefd-a0d9-4894-9b33-59f91b4d592f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:49 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:49 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f 1073741824 Sep 12 07:32:49 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5a7938-f90c-4a37-bf7c-eeb96e601b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89ae35f-891f-4c3c-ba36-9237ec021440', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c09e6ed-20de-484d-9607-bb2c0c74ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume volume-b89ae35f-891f-4c3c-ba36-9237ec021440 (b89ae35f-891f-4c3c-ba36-9237ec021440): created successfully Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c09e6ed-20de-484d-9607-bb2c0c74ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (3a6bab2d-e829-469e-8b16-54e601ac561f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:49 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cf926761-e1ff-4a9d-92a6-d0101c0135e0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created volume successfully. Sep 12 07:32:49 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1" returned: 0 in 0.380s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:49 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1 Sep 12 07:32:49 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:49 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1" released by "delete_volume" :: held 0.692s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:49 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f 1073741824" returned: 0 in 0.434s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Created reservations ['59ebf370-3bb6-4923-9579-b8ece33087bd', '260d0f24-bcdf-4b0d-8920-457dce5ae44b', 'bd96fcdf-51d8-419c-a966-ea403a5c0886', '084ed1e2-084f-4e25-8b98-17f8beaa6c22'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:50 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f Sep 12 07:32:50 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:50 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:50 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:50 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.079s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431595651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471ba6da-b113-4444-8a1d-c3d331b301fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:47Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Creating volume 471ba6da-b113-4444-8a1d-c3d331b301fe {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:50 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:50 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe 1073741824 Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ca0af4-9993-4ac3-9cd8-d0ea539cf2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:50 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafb9747-7274-4f03-be80-7eb50a9d895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-0eaf237d-e542-4135-8284-ca7ab36342e4-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:50 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:50 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f (cfc5fefd-a0d9-4894-9b33-59f91b4d592f): created successfully Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafb9747-7274-4f03-be80-7eb50a9d895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (068d8c38-760e-4a79-8935-45397d21791b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-0eaf237d-e542-4135-8284-ca7ab36342e4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.298s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Deleted volume successfully. Sep 12 07:32:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f8d91274-0bb4-463e-b568-02c241829fc0 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created volume successfully. Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-quobyte-0eaf237d-e542-4135-8284-ca7ab36342e4" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b1188774-79bf-475d-aabe-babd3dd5662c tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-f7daa16c-a3cd-4faf-8d86-b85a1b465ea1-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-0eaf237d-e542-4135-8284-ca7ab36342e4" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[989ba014-eb29-4204-8185-ea7e92ecc50b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:50 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 Sep 12 07:32:50 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:50 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe 1073741824" returned: 0 in 0.481s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:50 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe Sep 12 07:32:50 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:50 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4" returned: 0 in 0.387s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:50 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4 Sep 12 07:32:50 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:51 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.274s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643505698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe48f86-f211-4eb3-9a83-6ca90409c4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:48Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Creating volume 0fe48f86-f211-4eb3-9a83-6ca90409c4b0 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:51 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bae1b6c-8bfb-4204-9a7a-e40a938f074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471ba6da-b113-4444-8a1d-c3d331b301fe', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9862d3a2-80c2-4ca6-85bc-715bdf4708ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:51 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 1073741824 Sep 12 07:32:51 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:51 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume volume-471ba6da-b113-4444-8a1d-c3d331b301fe (471ba6da-b113-4444-8a1d-c3d331b301fe): created successfully Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9862d3a2-80c2-4ca6-85bc-715bdf4708ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (5e0117c8-116e-4157-91f7-2687af01f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-531ddbaa-fab0-4f28-a31c-a6829785d7c9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created volume successfully. Sep 12 07:32:51 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0eaf237d-e542-4135-8284-ca7ab36342e4" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-0eaf237d-e542-4135-8284-ca7ab36342e4" released by "delete_volume" :: held 0.693s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Created reservations ['723fd22a-18ef-46bb-b599-68f9ffd4a9b3', 'd78773df-8e6a-457f-9073-3758940b41a7', '5c150db2-2773-415a-9c15-4b6968fc99b4', 'd8c860eb-4705-4b75-a3b5-0fac08d58abc'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:51 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:51 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-df7cc08c-590d-4b33-a735-9a6c0d65c334-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-df7cc08c-590d-4b33-a735-9a6c0d65c334-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-quobyte-df7cc08c-590d-4b33-a735-9a6c0d65c334" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-df7cc08c-590d-4b33-a735-9a6c0d65c334" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:51 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 1073741824" returned: 0 in 0.624s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:51 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72cb9a4-45d9-478b-b2c7-ff9f53d24d28]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Deleted volume successfully. Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:51 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-6117f685-4b26-4041-97d5-f021347c49c2 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-0eaf237d-e542-4135-8284-ca7ab36342e4-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:51 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 Sep 12 07:32:51 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:51 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 Sep 12 07:32:51 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:52 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0" returned: 0 in 0.261s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.818s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3494d894-4039-40b9-b5a5-2066a008d15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1fe093fe1b49429cd5847887b6cfc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:45Z,use_quota=True,user_id='24378c97ff2a45b298102350e2cb8b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Creating volume 3494d894-4039-40b9-b5a5-2066a008d15d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:52 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78c3aba-e28b-437f-9b57-0b7915489adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f94786-ad57-4368-839a-820cda02b750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:52 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d 1073741824 Sep 12 07:32:52 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:52 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 (0fe48f86-f211-4eb3-9a83-6ca90409c4b0): created successfully Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f94786-ad57-4368-839a-820cda02b750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (936e2d2e-06e4-4af0-ad97-17749fd579c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d6d75521-577b-464f-b35f-879af4b8d8eb tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created volume successfully. Sep 12 07:32:52 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334" returned: 0 in 0.443s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:52 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334 Sep 12 07:32:52 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:52 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-df7cc08c-590d-4b33-a735-9a6c0d65c334" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-df7cc08c-590d-4b33-a735-9a6c0d65c334" released by "delete_volume" :: held 0.783s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:52 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d 1073741824" returned: 0 in 0.418s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Created reservations ['8adb9e79-6ff1-44a1-a5e6-c37e3a1dbff1', 'c7fde2c0-3a99-4dc3-b6c4-cb9760503b8d', '9122058e-09db-4b44-bc38-c6c89beb1d4e', '1426f143-fa39-4cd4-a646-039ea71056b4'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:52 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d Sep 12 07:32:52 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:52 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:52 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-cb4c9959-64bf-44a8-a649-c45b9c542a2d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-cb4c9959-64bf-44a8-a649-c45b9c542a2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-quobyte-cb4c9959-64bf-44a8-a649-c45b9c542a2d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-cb4c9959-64bf-44a8-a649-c45b9c542a2d" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:52 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d" returned: 0 in 0.296s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2086750955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5351445c-d824-45b4-8029-27b6ce615da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09320f8e45249ab949ad2ac4393b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:48Z,use_quota=True,user_id='1197dd37a8684ad994f3158fae70f4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Creating volume 5351445c-d824-45b4-8029-27b6ce615da6 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:52 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1460c-ae24-48c5-9274-27ba990af712]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:52 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 1073741824 Sep 12 07:32:52 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Attempting download of 520c4c95-e2c0-4f64-955a-07fa32a203bf ((None, [{'url': 'file:///opt/stack/data/glance/images/520c4c95-e2c0-4f64-955a-07fa32a203bf', 'metadata': {}}])) to volume 3494d894-4039-40b9-b5a5-2066a008d15d. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:32:52 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.303s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Deleted volume successfully. Sep 12 07:32:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d02cf684-cc83-4fa3-b09b-fff3fd0d95fe tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-df7cc08c-590d-4b33-a735-9a6c0d65c334-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dde36c-dfe6-46a8-a4e8-6b8f614e1931]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d Sep 12 07:32:53 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw Sep 12 07:32:53 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d" returned: 0 in 0.398s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d Sep 12 07:32:53 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 1073741824" returned: 0 in 0.459s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:53 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw" returned: 0 in 0.353s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 Sep 12 07:32:53 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw Sep 12 07:32:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cb4c9959-64bf-44a8-a649-c45b9c542a2d" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-cb4c9959-64bf-44a8-a649-c45b9c542a2d" released by "delete_volume" :: held 0.727s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Created reservations ['19bd33ee-4d8e-4713-8432-753a52b74dc9', '58f70c3e-7fe8-4682-b1a6-9b576005c2c1', 'df6876b7-a6d8-44e4-99f1-36d3be2d10da', '5f4ab83c-fd47-4ffa-8f89-14b22e12e312'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:53 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6" returned: 0 in 0.269s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.161s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30635906-9bbf-43ae-89ac-e587f16754c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be24bd9d2b748aca630052a1461ac30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:47Z,use_quota=True,user_id='c114ae201c1f48afa944c8411a593da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12961f75-5083-491f-9f34-68dec537f20b),volume_type_id=12961f75-5083-491f-9f34-68dec537f20b)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Creating volume 30635906-9bbf-43ae-89ac-e587f16754c9 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:53 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e53f3a-1133-4799-bfdd-621abcad5025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5351445c-d824-45b4-8029-27b6ce615da6', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:53 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 1073741824 Sep 12 07:32:53 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae34af2d-3ac1-452d-9556-61bd79f62990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw" returned: 1 in 0.361s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520c4c95-e2c0-4f64-955a-07fa32a203bf_nvk9knmw' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[58823bf8-0ad0-489f-baa1-6b1a3e56e544]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Volume volume-5351445c-d824-45b4-8029-27b6ce615da6 (5351445c-d824-45b4-8029-27b6ce615da6): created successfully Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae34af2d-3ac1-452d-9556-61bd79f62990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Flow 'volume_create_manager' (e92c434f-cc5b-43cd-8c94-0f517cd143c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:53 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a5462ea8-9514-4079-9dc0-2f76420b435a tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created volume successfully. Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:53 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:53 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD Sep 12 07:32:53 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "cinder-quobyte-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a7bd17-3bc1-4f6c-9e13-e64bbb7c5f03]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.312s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Deleted volume successfully. Sep 12 07:32:54 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-98367bf3-d24f-45b9-9354-c831a43b90ae tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-cb4c9959-64bf-44a8-a649-c45b9c542a2d-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec Sep 12 07:32:54 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:54 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 1073741824" returned: 0 in 0.598s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD Sep 12 07:32:54 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 Sep 12 07:32:54 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:54 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:54 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] 520c4c95-e2c0-4f64-955a-07fa32a203bf was raw, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:32:54 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d Sep 12 07:32:54 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:54 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Attempting download of abab0820-869b-427e-9a09-9694a27a43ff ((None, [{'url': 'file:///opt/stack/data/glance/images/abab0820-869b-427e-9a09-9694a27a43ff', 'metadata': {}}])) to volume 30635906-9bbf-43ae-89ac-e587f16754c9. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a438e610-7b51-4fed-840d-76d6c21b52f1]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-quobyte-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec" released by "delete_volume" :: held 0.706s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:54 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35 Sep 12 07:32:54 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-5351445c-d824-45b4-8029-27b6ce615da6-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Created reservations ['0929a280-148c-49ec-a979-17838b58cfcb', '73d350d1-47f1-4d00-8110-a41833e7bcbc', '813b2ac5-e1ad-4613-8a63-58aabca2ae2c', '3936056b-fbda-4874-8a69-9599cd15b4e5'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-5351445c-d824-45b4-8029-27b6ce615da6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-quobyte-5351445c-d824-45b4-8029-27b6ce615da6" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-5351445c-d824-45b4-8029-27b6ce615da6" acquired by "delete_volume" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171dd04-ca58-454d-94a4-426a8d2ed7de]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:54 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:54 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:55 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d" returned: 0 in 0.575s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_520c4c95-e2c0-4f64-955a-07fa32a203bf_ita_o29xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:32:55 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Converted 0.00 MB image at 0.00 MB/s Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:55 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35" returned: 0 in 0.498s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:55 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 Sep 12 07:32:55 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:55 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d 1G Sep 12 07:32:55 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:55 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.289s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:55 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Deleted volume successfully. Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bb78da90-2b23-4776-b1a2-9e7e52c63fc9 tempest-CreateVolumesFromImageTest-316246253 None] Lock "cinder-b7bd6080-d34b-4baf-bcd0-135ebc3ffbec-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:55 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35 Sep 12 07:32:55 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:55 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6" returned: 0 in 0.561s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:55 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d 1G" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Downloaded image 520c4c95-e2c0-4f64-955a-07fa32a203bf ((None, [{'url': 'file:///opt/stack/data/glance/images/520c4c95-e2c0-4f64-955a-07fa32a203bf', 'metadata': {}}])) to volume 3494d894-4039-40b9-b5a5-2066a008d15d successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Temporary image 520c4c95-e2c0-4f64-955a-07fa32a203bf for user 24378c97ff2a45b298102350e2cb8b21 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Marking volume 3494d894-4039-40b9-b5a5-2066a008d15d as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35" returned: 1 in 0.411s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abab0820-869b-427e-9a09-9694a27a43ff_p23_ja35' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:55 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6 Sep 12 07:32:55 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e9203f-3bb9-45c9-8798-2f82c8bb958e]: (4, 'raw') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Copying metadata from image 520c4c95-e2c0-4f64-955a-07fa32a203bf to 3494d894-4039-40b9-b5a5-2066a008d15d. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Creating volume glance metadata for volume 3494d894-4039-40b9-b5a5-2066a008d15d backed by image 520c4c95-e2c0-4f64-955a-07fa32a203bf with: {'image_id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9aebfa8bc2747a774c87da2b3a308371', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d0c088-70a9-41de-bff2-60a653773c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3494d894-4039-40b9-b5a5-2066a008d15d', 'volume_size': 1, 'image_id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/520c4c95-e2c0-4f64-955a-07fa32a203bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9aebfa8bc2747a774c87da2b3a308371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b1fe093fe1b49429cd5847887b6cfc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3609d8923be7b907bbc835b5c71f4af798c9c1925afdf5a90e7e0aa6f67cf8689dc2bdbc2184fd32da5668a53780952ef2dbf3e5ef4ed078a7ab270fae20678', 'id': '520c4c95-e2c0-4f64-955a-07fa32a203bf', 'created_at': datetime.datetime(2026, 9, 12, 5, 32, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 32, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/520c4c95-e2c0-4f64-955a-07fa32a203bf/file', 'properties': {}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0383d9d-fd02-4a5d-8f02-4d24b88a19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:55 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Volume volume-3494d894-4039-40b9-b5a5-2066a008d15d (3494d894-4039-40b9-b5a5-2066a008d15d): created successfully Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0383d9d-fd02-4a5d-8f02-4d24b88a19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Flow 'volume_create_manager' (360cad8e-40db-449a-a684-8ec4eb1eff4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:55 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD Sep 12 07:32:55 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:55 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-30f372da-aa1a-42cb-aacd-315c65688aa4 tempest-VolumeImageDependencyTests-929751765 None] Created volume successfully. Sep 12 07:32:55 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5351445c-d824-45b4-8029-27b6ce615da6" returned: 0 in 0.272s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-5351445c-d824-45b4-8029-27b6ce615da6" released by "delete_volume" :: held 0.895s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created reservations ['13c8110d-c471-42c2-bc8b-8e8e021ba29b', '7668e65a-a41f-45bd-8a16-3bfae6efcfe1', '490e8a0c-753a-4bf6-b66b-abfa3a2de1b2', 'a631dc3e-c80a-43bd-a7cd-29e21db06f3b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:55 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:55 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:55 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-0fe48f86-f211-4eb3-9a83-6ca90409c4b0-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-0fe48f86-f211-4eb3-9a83-6ca90409c4b0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-quobyte-0fe48f86-f211-4eb3-9a83-6ca90409c4b0" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-0fe48f86-f211-4eb3-9a83-6ca90409c4b0" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:56 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD Sep 12 07:32:56 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c8861-9dcb-488f-b39e-ee7ef7ec13b3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:56 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 Sep 12 07:32:56 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:56 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Acquiring lock "cinder-3494d894-4039-40b9-b5a5-2066a008d15d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.448s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Deleted volume successfully. Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Lock "cinder-3494d894-4039-40b9-b5a5-2066a008d15d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-049f0bdd-43d3-43cf-9ffb-6b89d7f707a2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-5351445c-d824-45b4-8029-27b6ce615da6-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:56 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD" returned: 1 in 0.533s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] abab0820-869b-427e-9a09-9694a27a43ff was raw, converting to qcow2 {{(pid=88013) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Acquiring lock "cinder-quobyte-3494d894-4039-40b9-b5a5-2066a008d15d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:56 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 Sep 12 07:32:56 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Lock "cinder-quobyte-3494d894-4039-40b9-b5a5-2066a008d15d" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd918b12-e11e-4837-b651-99fe3e8fcd1f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:56 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0" returned: 0 in 0.482s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:56 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0 Sep 12 07:32:56 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:56 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d Sep 12 07:32:56 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:56 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-0fe48f86-f211-4eb3-9a83-6ca90409c4b0" returned: 0 in 0.299s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-0fe48f86-f211-4eb3-9a83-6ca90409c4b0" released by "delete_volume" :: held 0.834s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:57 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9" returned: 0 in 0.544s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_abab0820-869b-427e-9a09-9694a27a43ff_4tv0a9jqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:32:57 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Converted 0.00 MB image at 0.00 MB/s Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:57 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d" returned: 0 in 0.485s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:57 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 1G Sep 12 07:32:57 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:57 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d Sep 12 07:32:57 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created reservations ['3c03be09-98a8-4f44-93e0-5046d0eacf43', '79d36490-ffed-4107-abba-031449d8a01a', '6e173268-6880-4259-aeab-fed6940c7cc2', '3aeb4d08-b573-4230-b87c-c06ff9998935'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:57 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:57 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-471ba6da-b113-4444-8a1d-c3d331b301fe-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-471ba6da-b113-4444-8a1d-c3d331b301fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-quobyte-471ba6da-b113-4444-8a1d-c3d331b301fe" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-471ba6da-b113-4444-8a1d-c3d331b301fe" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8f37c-547f-4bd6-b497-067cd612a590]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:57 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3494d894-4039-40b9-b5a5-2066a008d15d" returned: 0 in 0.437s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Lock "cinder-quobyte-3494d894-4039-40b9-b5a5-2066a008d15d" released by "delete_volume" :: held 0.994s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 1G" returned: 0 in 0.526s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Downloaded image abab0820-869b-427e-9a09-9694a27a43ff ((None, [{'url': 'file:///opt/stack/data/glance/images/abab0820-869b-427e-9a09-9694a27a43ff', 'metadata': {}}])) to volume 30635906-9bbf-43ae-89ac-e587f16754c9 successfully. {{(pid=88013) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Temporary image abab0820-869b-427e-9a09-9694a27a43ff for user c114ae201c1f48afa944c8411a593da7 is deleted. {{(pid=88013) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.volume_utils [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Marking volume 30635906-9bbf-43ae-89ac-e587f16754c9 as bootable. {{(pid=88013) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Copying metadata from image abab0820-869b-427e-9a09-9694a27a43ff to 30635906-9bbf-43ae-89ac-e587f16754c9. {{(pid=88013) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Creating volume glance metadata for volume 30635906-9bbf-43ae-89ac-e587f16754c9 backed by image abab0820-869b-427e-9a09-9694a27a43ff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '90b2434d0d156c1d33d52c948a6d2632', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88013) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 12 07:32:57 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe Sep 12 07:32:57 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:57 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Deleted volume successfully. Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Created reservations ['8ecdb8e4-104e-4fe9-8ad9-9e726ec80941', '76efd7d3-1aab-474a-b3d7-7e11b3217241', '0e4cd916-e0e1-450f-b295-c674d21a976a', 'ebc5ed61-9dc0-410e-8c7f-5f8e078ff250'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3db4a8cd-076f-4db1-abae-f8f81155ded2 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-0fe48f86-f211-4eb3-9a83-6ca90409c4b0-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945c061f-f580-4fd9-9b43-d1aa126ac422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30635906-9bbf-43ae-89ac-e587f16754c9', 'volume_size': 1, 'image_id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/abab0820-869b-427e-9a09-9694a27a43ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90b2434d0d156c1d33d52c948a6d2632', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7be24bd9d2b748aca630052a1461ac30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1157aabd236d5221b1ec17edffe0c7faaf10e221c290c7fc4ebcb33d97b7e7fb29988bbced68574f88ebc8cf8623f3bc42a929cdb3a215dda0bef7019b5cf54e', 'id': 'abab0820-869b-427e-9a09-9694a27a43ff', 'created_at': datetime.datetime(2026, 9, 12, 5, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 5, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/abab0820-869b-427e-9a09-9694a27a43ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc76574-73bd-43e2-9271-9f84c89e7a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:57 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Volume volume-30635906-9bbf-43ae-89ac-e587f16754c9 (30635906-9bbf-43ae-89ac-e587f16754c9): created successfully Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc76574-73bd-43e2-9271-9f84c89e7a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Flow 'volume_create_manager' (744cbb11-90ec-4dff-a418-a26c156f077c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:57 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:57 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-436e336b-3ad6-4426-8d01-1d1b70f7718f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Created volume successfully. Sep 12 07:32:57 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe" returned: 0 in 0.509s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:57 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe Sep 12 07:32:57 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:58 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:58 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Deleted volume successfully. Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-674dcdbe-40b0-4229-8d3b-424e31b145bd tempest-VolumeImageDependencyTests-929751765 None] Lock "cinder-3494d894-4039-40b9-b5a5-2066a008d15d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:58 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-471ba6da-b113-4444-8a1d-c3d331b301fe" returned: 0 in 0.278s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-471ba6da-b113-4444-8a1d-c3d331b301fe" released by "delete_volume" :: held 0.843s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created reservations ['06b44280-24d6-4231-a06f-c4aa6fc18cb3', 'd5d671fb-35ca-47b2-9d2a-859f8319042d', '1dbbc936-8eeb-412e-9bae-29fbf24e6439', '61f47e80-6966-4b1b-b0f3-1fd89b56ced0'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:58 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:58 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-cfc5fefd-a0d9-4894-9b33-59f91b4d592f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-cfc5fefd-a0d9-4894-9b33-59f91b4d592f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-quobyte-cfc5fefd-a0d9-4894-9b33-59f91b4d592f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-cfc5fefd-a0d9-4894-9b33-59f91b4d592f" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d59a7-1903-4295-8244-3069f642245b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:58 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.344s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:58 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Deleted volume successfully. Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-101a65e2-48d4-4706-9d70-4330c4c262d5 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-471ba6da-b113-4444-8a1d-c3d331b301fe-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:58 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f Sep 12 07:32:58 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Acquiring lock "cinder-30635906-9bbf-43ae-89ac-e587f16754c9-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "cinder-30635906-9bbf-43ae-89ac-e587f16754c9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (57ca17b0-1a4a-4a2f-b1cf-67a040c90a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732eaf96-6f15-48f1-9c2a-c008f8b2d2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732eaf96-6f15-48f1-9c2a-c008f8b2d2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075561220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db444fa9-41cb-4c20-a509-d3255590db16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:59Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9a9bbd-7b41-4578-8994-11a0fa319a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9a9bbd-7b41-4578-8994-11a0fa319a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633eea3b-f768-45f4-9745-2ca8bd75f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633eea3b-f768-45f4-9745-2ca8bd75f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db444fa9-41cb-4c20-a509-d3255590db16', 'volume_name': 'volume-db444fa9-41cb-4c20-a509-d3255590db16', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aedb758-b17f-4187-972e-f98af336630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aedb758-b17f-4187-972e-f98af336630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84832438-42de-4ca4-b67c-9e0c28f5abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:32:58 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume db444fa9-41cb-4c20-a509-d3255590db16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db444fa9-41cb-4c20-a509-d3255590db16', 'volume_size': 1} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075561220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db444fa9-41cb-4c20-a509-d3255590db16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:32:59Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating volume db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:32:58 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:32:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f" returned: 0 in 0.442s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 1073741824 Sep 12 07:32:59 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Acquiring lock "cinder-quobyte-30635906-9bbf-43ae-89ac-e587f16754c9" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "cinder-quobyte-30635906-9bbf-43ae-89ac-e587f16754c9" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:59 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f Sep 12 07:32:59 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5547a-c8ac-4f1f-b63f-716612a477c1]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 Sep 12 07:32:59 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:59 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-cfc5fefd-a0d9-4894-9b33-59f91b4d592f" returned: 0 in 0.314s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-cfc5fefd-a0d9-4894-9b33-59f91b4d592f" released by "delete_volume" :: held 0.814s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created reservations ['99de9abe-5c1e-4647-9b32-dc3c46c064e1', 'ca0fa27d-4234-4563-8478-e8ddb39e7e65', 'bb06f470-e070-4f8e-bd18-383dfd81f3bd', '164e4c2b-da10-44ce-aca3-4209c33dfd63'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:32:59 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:59 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 1073741824" returned: 0 in 0.591s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:59 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9" returned: 0 in 0.506s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-b89ae35f-891f-4c3c-ba36-9237ec021440-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:59 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9 Sep 12 07:32:59 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-b89ae35f-891f-4c3c-ba36-9237ec021440-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 Sep 12 07:32:59 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-quobyte-b89ae35f-891f-4c3c-ba36-9237ec021440" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-b89ae35f-891f-4c3c-ba36-9237ec021440" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b687432-4112-4991-a464-8fa86545032c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:32:59 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.365s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:32:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Deleted volume successfully. Sep 12 07:32:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-42b71f87-7ecd-447e-9fd1-92106d5f473f tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-cfc5fefd-a0d9-4894-9b33-59f91b4d592f-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:00 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16" returned: 0 in 0.331s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:00 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-30635906-9bbf-43ae-89ac-e587f16754c9" returned: 0 in 0.415s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84832438-42de-4ca4-b67c-9e0c28f5abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db444fa9-41cb-4c20-a509-d3255590db16', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9007a1b2-675e-4140-aadf-7168a3829bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "cinder-quobyte-30635906-9bbf-43ae-89ac-e587f16754c9" released by "delete_volume" :: held 0.996s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:00 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 Sep 12 07:33:00 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:00 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume volume-db444fa9-41cb-4c20-a509-d3255590db16 (db444fa9-41cb-4c20-a509-d3255590db16): created successfully Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9007a1b2-675e-4140-aadf-7168a3829bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (57ca17b0-1a4a-4a2f-b1cf-67a040c90a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-66316287-dce7-45a7-969f-ee6a1a28ce16 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created volume successfully. Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Created reservations ['75d7417a-1fc7-448c-b08f-95e83d9773d5', '9f1de9cd-a55f-45fe-9e13-bdc67fbda178', '33379c60-7c7c-4f9f-98bf-14449787b93d', '6d6eb1d7-5009-4699-9214-a1a6cb4d8b70'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:00 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:00 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:00 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440" returned: 0 in 0.519s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:00 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440 Sep 12 07:33:00 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:00 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Deleted volume successfully. Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-a098e314-f72d-4eb6-a941-c84a6a0ac47f tempest-VolumeAndVolumeTypeFromImageTest-146312033 None] Lock "cinder-30635906-9bbf-43ae-89ac-e587f16754c9-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:00 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-b89ae35f-891f-4c3c-ba36-9237ec021440" returned: 0 in 0.283s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-b89ae35f-891f-4c3c-ba36-9237ec021440" released by "delete_volume" :: held 0.872s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created reservations ['8d5dba42-15c5-4fc0-b377-29ca77ed9549', '1dc63c70-9afa-4201-9a60-068faaa12678', '1e9b76f6-2839-43e5-b0fe-e85f5387fc32', '37814535-5651-4ca7-9e09-5fa37e499086'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:00 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:00 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-5a89397f-7d43-48ee-ab8b-0e428b7493b7-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-5a89397f-7d43-48ee-ab8b-0e428b7493b7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "cinder-quobyte-5a89397f-7d43-48ee-ab8b-0e428b7493b7" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-5a89397f-7d43-48ee-ab8b-0e428b7493b7" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc556f-3950-4735-b65c-1e23ff91b22b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating offline snapshot 21886218-8572-4505-9304-c1b7cc383e0e of volume db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52c847a-a53c-4c86-83a7-c37cb2bead65]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:01 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:01 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 Sep 12 07:33:01 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.455s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Deleted volume successfully. Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-c3e2ba4e-4fa0-41ec-8782-25c20ec1a7b7 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-b89ae35f-891f-4c3c-ba36-9237ec021440-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:01 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 Sep 12 07:33:01 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:01 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7" returned: 0 in 0.549s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:01 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7 Sep 12 07:33:01 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:01 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16" returned: 0 in 0.487s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:01 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e 1G Sep 12 07:33:01 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:01 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5a89397f-7d43-48ee-ab8b-0e428b7493b7" returned: 0 in 0.294s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-quobyte-5a89397f-7d43-48ee-ab8b-0e428b7493b7" released by "delete_volume" :: held 0.911s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:01 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Created reservations ['ba82f367-5eea-4490-acbd-4b2e085de9c8', '83e9cc25-3000-4197-afbc-4b931458bcb1', '1611d6c3-0390-4d1f-9802-cf03940573d0', '94f2fbe9-5eb1-4ab0-84ff-746d7432909d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:02 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:02 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:02 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e 1G" returned: 0 in 0.528s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db444fa9-41cb-4c20-a509-d3255590db16 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:02 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db444fa9-41cb-4c20-a509-d3255590db16 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e Sep 12 07:33:02 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:02 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.324s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Deleted volume successfully. Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1fd04488-e6d5-4083-9f0f-1c77692d0ed9 tempest-CreateVolumesFromSourceVolumeTest-20302858 None] Lock "cinder-5a89397f-7d43-48ee-ab8b-0e428b7493b7-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:02 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db444fa9-41cb-4c20-a509-d3255590db16 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e" returned: 0 in 0.350s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:02 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e is being set with open permissions: ugo+rw Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:02 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e Sep 12 07:33:02 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:02 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:03 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info Sep 12 07:33:03 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:03 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info" returned: 0 in 0.449s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:03 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info is being set with open permissions: ugo+rw Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:03 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info Sep 12 07:33:03 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=269,cinder:SELECT=179,cinder:INSERT=77,cinder:DELETE=28 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Flow 'volume_create_manager' (c8822388-9bb9-4d49-bf26-9cc7f5ebd567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d6e235-e4f3-4eb3-82d9-16dc909087a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d6e235-e4f3-4eb3-82d9-16dc909087a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab658fe-4d23-477a-9587-57af5c5fd5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746ffc056dbf48ccbf1aae488e9356d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:03Z,use_quota=True,user_id='85853fed058345c296c68a6a882933b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46787018-e359-4353-b72f-0b9bc1805e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46787018-e359-4353-b72f-0b9bc1805e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffde6613-e5e2-4487-9e16-72f83a51de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffde6613-e5e2-4487-9e16-72f83a51de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab658fe-4d23-477a-9587-57af5c5fd5f4', 'volume_name': 'volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbc149f-2087-4a18-ba25-687488ad8548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbc149f-2087-4a18-ba25-687488ad8548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df8a0f8-8a1e-405f-b3ff-b5697d6979e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:03 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Volume 6ab658fe-4d23-477a-9587-57af5c5fd5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4', 'volume_size': 1} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:03 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.info" returned: 0 in 0.296s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab658fe-4d23-477a-9587-57af5c5fd5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746ffc056dbf48ccbf1aae488e9356d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:03Z,use_quota=True,user_id='85853fed058345c296c68a6a882933b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Creating volume 6ab658fe-4d23-477a-9587-57af5c5fd5f4 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:03 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:03 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 1073741824 Sep 12 07:33:03 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:03 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=193,cinder:UPDATE=276,cinder:INSERT=64,cinder:DELETE=21 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:33:03 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cedcfe11-e897-44b6-9efb-1767c45a43ed tempest-CreateVolumesFromSnapshotTest-1772548765 None] Create snapshot completed successfully Sep 12 07:33:04 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 1073741824" returned: 0 in 0.576s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:04 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 Sep 12 07:33:04 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:04 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4" returned: 0 in 0.301s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df8a0f8-8a1e-405f-b3ff-b5697d6979e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540d3f2d-6a43-4d21-9c24-d993cda1a7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:04 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Volume volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 (6ab658fe-4d23-477a-9587-57af5c5fd5f4): created successfully Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540d3f2d-6a43-4d21-9c24-d993cda1a7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Flow 'volume_create_manager' (c8822388-9bb9-4d49-bf26-9cc7f5ebd567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5cd70790-e345-49a3-aaaf-89b1f03d1023 tempest-CinderUnicodeTest-1898327727 None] Created volume successfully. Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (176dcde9-fc17-4a65-80f7-d16b42d2ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35cda41-0a97-4d0c-927b-06e53d728b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35cda41-0a97-4d0c-927b-06e53d728b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854615096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c883d0fb-7aa8-43e2-b630-5a483cf9dec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:05Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3472b496-8093-4a17-ad02-525a30fb1b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3472b496-8093-4a17-ad02-525a30fb1b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fff87d2-34e4-425e-9f2e-08ab7d7c749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fff87d2-34e4-425e-9f2e-08ab7d7c749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c883d0fb-7aa8-43e2-b630-5a483cf9dec4', 'volume_name': 'volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537e6c13-6ddd-4a77-9a05-6293da0e7e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537e6c13-6ddd-4a77-9a05-6293da0e7e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48c75c1-53a9-477a-bd62-e9a0cb80bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume c883d0fb-7aa8-43e2-b630-5a483cf9dec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4', 'volume_size': 1} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854615096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c883d0fb-7aa8-43e2-b630-5a483cf9dec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:05Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating volume c883d0fb-7aa8-43e2-b630-5a483cf9dec4 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:05 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:05 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 1073741824 Sep 12 07:33:05 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (a7eabcb1-d7fc-4a97-80e1-4568f2daf531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc798409-f4b6-4c61-9e07-f760a52aca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc798409-f4b6-4c61-9e07-f760a52aca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1900306217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bfeb45-acf7-4b7f-9b8d-5cca074aae4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:05Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7768b87f-9a44-46d3-8167-f5e2171d76fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7768b87f-9a44-46d3-8167-f5e2171d76fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45314d1-d1d0-4efb-bc42-fa06ae9d852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45314d1-d1d0-4efb-bc42-fa06ae9d852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bfeb45-acf7-4b7f-9b8d-5cca074aae4a', 'volume_name': 'volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e4d693-a880-4072-b61b-9ca9a40b4a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e4d693-a880-4072-b61b-9ca9a40b4a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ee765e-1de3-4bfa-b80e-b4cbd5b109da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume 25bfeb45-acf7-4b7f-9b8d-5cca074aae4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a', 'volume_size': 1} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:05 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 1073741824" returned: 0 in 0.745s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:05 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 Sep 12 07:33:05 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (99c4c788-33de-4e7f-880c-bc57f23eba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77e4ed0-4652-448c-b4e8-a457d6469287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77e4ed0-4652-448c-b4e8-a457d6469287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114028626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eeb2e1-210f-4cf7-85b8-59b39225c0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:06Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6261a9c-c009-4a3a-a6ed-4e5bfbe92e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6261a9c-c009-4a3a-a6ed-4e5bfbe92e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0bab21-6748-4bd5-81cf-0c080ab89635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0bab21-6748-4bd5-81cf-0c080ab89635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63eeb2e1-210f-4cf7-85b8-59b39225c0e4', 'volume_name': 'volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885b2154-8adc-4d0d-9598-798057ff00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885b2154-8adc-4d0d-9598-798057ff00a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e2efe9-60ee-4449-8cca-0ad6ee7a4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume 63eeb2e1-210f-4cf7-85b8-59b39225c0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4', 'volume_size': 1} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:06 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1900306217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bfeb45-acf7-4b7f-9b8d-5cca074aae4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:05Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating volume 25bfeb45-acf7-4b7f-9b8d-5cca074aae4a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:06 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48c75c1-53a9-477a-bd62-e9a0cb80bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66f5fa8-f175-4d27-be22-fba80a933153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:06 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a 1073741824 Sep 12 07:33:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 (c883d0fb-7aa8-43e2-b630-5a483cf9dec4): created successfully Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66f5fa8-f175-4d27-be22-fba80a933153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:06 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (176dcde9-fc17-4a65-80f7-d16b42d2ca26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-944cc95b-e0b3-4e79-92db-e600a1c4109c tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created volume successfully. Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (a91c945c-a4f0-4bfd-9c57-ab7d123d6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d81a4ed-e33c-4fb5-b30f-9c4bb9a4c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d81a4ed-e33c-4fb5-b30f-9c4bb9a4c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-242755086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:07Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d8772a-c18e-491d-970c-8c2e68df89c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d8772a-c18e-491d-970c-8c2e68df89c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f269a6-7bb6-44dd-8e8e-80f39f043258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f269a6-7bb6-44dd-8e8e-80f39f043258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef', 'volume_name': 'volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5f3c04-e4c9-482d-940f-b73691a66810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5f3c04-e4c9-482d-940f-b73691a66810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bf0fda-592e-44b0-8717-e13f5d616e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume 6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef', 'volume_size': 1} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:07 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a 1073741824" returned: 0 in 0.882s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:07 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a Sep 12 07:33:07 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (694bf0a0-5588-42c0-84d1-836f4bb5837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf32df3-8117-481f-8092-2d3232bda687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Flow 'volume_create_manager' (70d9bf35-c570-456f-bdbe-7fb326279b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a73e3b-0c3a-4ada-b5a9-1b40a9c3f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a73e3b-0c3a-4ada-b5a9-1b40a9c3f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-349154965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65a427e-48c7-4507-abd4-13aaae5418fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746ffc056dbf48ccbf1aae488e9356d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:07Z,use_quota=True,user_id='85853fed058345c296c68a6a882933b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734e4e0f-d6ec-46ae-8344-4a4b55d908db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734e4e0f-d6ec-46ae-8344-4a4b55d908db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29a2cb4-8402-4a87-ac3d-0e9be3bf3edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29a2cb4-8402-4a87-ac3d-0e9be3bf3edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65a427e-48c7-4507-abd4-13aaae5418fb', 'volume_name': 'volume-a65a427e-48c7-4507-abd4-13aaae5418fb', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abed73f-4973-40ed-bb5a-bd7756cfe75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abed73f-4973-40ed-bb5a-bd7756cfe75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abc2cd2-3d23-4028-a8f0-e266f693c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Volume a65a427e-48c7-4507-abd4-13aaae5418fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65a427e-48c7-4507-abd4-13aaae5418fb', 'volume_size': 1} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf32df3-8117-481f-8092-2d3232bda687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874967476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97af7c7-ef2a-4a15-9042-1cc38f1c508d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:07Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfae59a-4bc1-415e-9bd3-b3afa7d65386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfae59a-4bc1-415e-9bd3-b3afa7d65386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2d54e4-d909-4154-b113-c82b465af16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2d54e4-d909-4154-b113-c82b465af16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97af7c7-ef2a-4a15-9042-1cc38f1c508d', 'volume_name': 'volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15c19ef-0264-4679-baf9-29908a96a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15c19ef-0264-4679-baf9-29908a96a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fb4cf9-ebd5-4b61-a03b-0305bd2d3c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume e97af7c7-ef2a-4a15-9042-1cc38f1c508d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d', 'volume_size': 1} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:07 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a" returned: 0 in 0.340s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114028626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eeb2e1-210f-4cf7-85b8-59b39225c0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:06Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating volume 63eeb2e1-210f-4cf7-85b8-59b39225c0e4 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:07 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:07 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 1073741824 Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ee765e-1de3-4bfa-b80e-b4cbd5b109da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c2c925-1768-4d81-9935-aa9f105754e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:07 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a (25bfeb45-acf7-4b7f-9b8d-5cca074aae4a): created successfully Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c2c925-1768-4d81-9935-aa9f105754e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:07 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (a7eabcb1-d7fc-4a97-80e1-4568f2daf531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c55ac55e-8225-4620-843a-013e9fd6f21f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created volume successfully. Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Flow 'volume_create_manager' (8fdda39d-aff4-4a65-9147-43dd391cff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a348280-3d45-4484-9e7d-4258e49c3cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:08 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a348280-3d45-4484-9e7d-4258e49c3cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-344052706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4006a0b8-51b1-4f29-ac21-749c8b49439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5521b6e1da9741d486ac49dfc0517656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:08Z,use_quota=True,user_id='d929cae1d6814e29bf00a1c9b70f08d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c322b-a36d-4691-9daa-34374e43b4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c322b-a36d-4691-9daa-34374e43b4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa43324c-b36a-41bd-9366-5e81deb5b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa43324c-b36a-41bd-9366-5e81deb5b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4006a0b8-51b1-4f29-ac21-749c8b49439f', 'volume_name': 'volume-4006a0b8-51b1-4f29-ac21-749c8b49439f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5ee6c7-ed4d-424f-b18d-b124c1b8ac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5ee6c7-ed4d-424f-b18d-b124c1b8ac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf11af4a-3b65-4cc0-929b-e5b87b8d52c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Volume 4006a0b8-51b1-4f29-ac21-749c8b49439f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4006a0b8-51b1-4f29-ac21-749c8b49439f', 'volume_size': 1} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 1073741824" returned: 0 in 0.630s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:08 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 Sep 12 07:33:08 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:08 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.344s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-242755086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:07Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating volume 6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:08 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e2efe9-60ee-4449-8cca-0ad6ee7a4919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:08 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef 1073741824 Sep 12 07:33:08 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d5af7f-2c47-4d45-9add-40bbcb4ea59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 (63eeb2e1-210f-4cf7-85b8-59b39225c0e4): created successfully Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d5af7f-2c47-4d45-9add-40bbcb4ea59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (99c4c788-33de-4e7f-880c-bc57f23eba01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:08 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bb5c8c50-5c00-4110-a7cd-b37f86a9249b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created volume successfully. Sep 12 07:33:08 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef 1073741824" returned: 0 in 0.439s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:09 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef Sep 12 07:33:09 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:09 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef" returned: 0 in 0.288s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-349154965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65a427e-48c7-4507-abd4-13aaae5418fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746ffc056dbf48ccbf1aae488e9356d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:07Z,use_quota=True,user_id='85853fed058345c296c68a6a882933b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Creating volume a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:09 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bf0fda-592e-44b0-8717-e13f5d616e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11144b1c-b085-474a-8f0d-ec74f2eba65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:09 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb 1073741824 Sep 12 07:33:09 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef (6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef): created successfully Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11144b1c-b085-474a-8f0d-ec74f2eba65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (a91c945c-a4f0-4bfd-9c57-ab7d123d6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9440d157-40d4-4e2d-8d75-13939df1c22e tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created volume successfully. Sep 12 07:33:09 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb 1073741824" returned: 0 in 0.444s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:09 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb Sep 12 07:33:09 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:10 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.462s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874967476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97af7c7-ef2a-4a15-9042-1cc38f1c508d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ac29a1470c4b869015e4b5bc9a0ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:07Z,use_quota=True,user_id='7a9f93f34d574aeda88478d2d20edef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Creating volume e97af7c7-ef2a-4a15-9042-1cc38f1c508d {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:10 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abc2cd2-3d23-4028-a8f0-e266f693c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65a427e-48c7-4507-abd4-13aaae5418fb', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81f3806-fdb3-4920-b8ed-70ad4f5d5d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:10 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d 1073741824 Sep 12 07:33:10 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Volume volume-a65a427e-48c7-4507-abd4-13aaae5418fb (a65a427e-48c7-4507-abd4-13aaae5418fb): created successfully Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81f3806-fdb3-4920-b8ed-70ad4f5d5d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Flow 'volume_create_manager' (70d9bf35-c570-456f-bdbe-7fb326279b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ec8cbf2b-1d66-4b9b-a641-51b85b52dcc4 tempest-CinderUnicodeTest-1898327727 None] Created volume successfully. Sep 12 07:33:10 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d 1073741824" returned: 0 in 0.530s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:10 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d Sep 12 07:33:10 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:10 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d" returned: 0 in 0.289s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.687s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-344052706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4006a0b8-51b1-4f29-ac21-749c8b49439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5521b6e1da9741d486ac49dfc0517656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:08Z,use_quota=True,user_id='d929cae1d6814e29bf00a1c9b70f08d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Creating volume 4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:10 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fb4cf9-ebd5-4b61-a03b-0305bd2d3c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d96bd7-d17c-4796-a1b9-ac33f007067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:10 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f 1073741824 Sep 12 07:33:10 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Volume volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d (e97af7c7-ef2a-4a15-9042-1cc38f1c508d): created successfully Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d96bd7-d17c-4796-a1b9-ac33f007067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Flow 'volume_create_manager' (694bf0a0-5588-42c0-84d1-836f4bb5837b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c2d38cf3-a809-4b92-93bf-9f095b7af686 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created volume successfully. Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:11 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f 1073741824" returned: 0 in 0.534s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:11 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f Sep 12 07:33:11 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-e97af7c7-ef2a-4a15-9042-1cc38f1c508d-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-e97af7c7-ef2a-4a15-9042-1cc38f1c508d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-e97af7c7-ef2a-4a15-9042-1cc38f1c508d" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-e97af7c7-ef2a-4a15-9042-1cc38f1c508d" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7af89-603e-420b-bd83-3c2e57863706]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:11 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f" returned: 0 in 0.263s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf11af4a-3b65-4cc0-929b-e5b87b8d52c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4006a0b8-51b1-4f29-ac21-749c8b49439f', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f314fe44-5c1c-4c8b-95ba-a8b6a473b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Creating offline snapshot 40e451f0-a486-4340-99a6-381cae4bd0b3 of volume a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:11 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Volume volume-4006a0b8-51b1-4f29-ac21-749c8b49439f (4006a0b8-51b1-4f29-ac21-749c8b49439f): created successfully Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f314fe44-5c1c-4c8b-95ba-a8b6a473b125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:11 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Flow 'volume_create_manager' (8fdda39d-aff4-4a65-9147-43dd391cff76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:11 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b4778-7e37-4023-af79-84fb8d2662f0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-a8c734d2-79a6-46c0-b182-08f0fc537484 tempest-VolumeDependencyTests-2124458824 None] Created volume successfully. Sep 12 07:33:11 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb Sep 12 07:33:11 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:12 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d" returned: 0 in 0.389s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:12 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d Sep 12 07:33:12 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:12 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb" returned: 0 in 0.426s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:12 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 1G Sep 12 07:33:12 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:12 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e97af7c7-ef2a-4a15-9042-1cc38f1c508d" returned: 0 in 0.281s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-e97af7c7-ef2a-4a15-9042-1cc38f1c508d" released by "delete_volume" :: held 0.720s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['93d32f6a-f2dc-4234-a0cc-1f19e435d485', 'b9afea50-a285-444f-975a-acf294b6c19a', '146d0064-6b90-4b28-a108-82ab816ff924', '22305c6b-b8c2-4eb0-ac55-261a04e4fa4c'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:12 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:12 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:12 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 1G" returned: 0 in 0.548s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65a427e-48c7-4507-abd4-13aaae5418fb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:12 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65a427e-48c7-4507-abd4-13aaae5418fb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 Sep 12 07:33:12 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:12 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleted volume successfully. Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-064d0e0c-acdf-4659-8de4-bdf7b097f8dc tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-e97af7c7-ef2a-4a15-9042-1cc38f1c508d-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f49b44-0897-4d2f-b8d6-bf83541fbd6b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:13 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef Sep 12 07:33:13 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:13 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65a427e-48c7-4507-abd4-13aaae5418fb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3" returned: 0 in 0.387s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:13 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 is being set with open permissions: ugo+rw Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:13 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 Sep 12 07:33:13 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:13 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef" returned: 0 in 0.387s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:13 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef Sep 12 07:33:13 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:13 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:13 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info Sep 12 07:33:13 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:13 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef" released by "delete_volume" :: held 0.716s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['bce21a25-cad5-42df-b3a5-5a767b694609', 'f995247b-f800-4e88-907d-be71ea2e465d', '4e170528-d299-413b-9180-4b18fb70cf3a', 'c98ee805-da4e-4d26-8438-9996fec33ccf'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:13 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:13 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info is being set with open permissions: ugo+rw Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:13 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:13 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:13 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info Sep 12 07:33:13 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-63eeb2e1-210f-4cf7-85b8-59b39225c0e4-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:14 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-63eeb2e1-210f-4cf7-85b8-59b39225c0e4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.275s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleted volume successfully. Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-63eeb2e1-210f-4cf7-85b8-59b39225c0e4" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82fd37f3-d579-4af5-aa41-c3e4df5855d3 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-6c6ddc63-a8c7-4c09-a3a6-f530efc6cdef-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:14 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.info" returned: 0 in 0.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-63eeb2e1-210f-4cf7-85b8-59b39225c0e4" acquired by "delete_volume" :: waited 0.056s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.527s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[09075c3b-75f6-4b87-8a52-4be866785214]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Creating offline snapshot 9ac960dc-b0d4-4482-ac6b-ed629f88add6 of volume 4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f5952c53-8ef2-459d-b664-5a0044899e81 tempest-CinderUnicodeTest-1898327727 None] Create snapshot completed successfully Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3839da81-cc02-437d-af04-898eba19aa4f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:14 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 Sep 12 07:33:14 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:14 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f Sep 12 07:33:14 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-40e451f0-a486-4340-99a6-381cae4bd0b3-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-40e451f0-a486-4340-99a6-381cae4bd0b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-quobyte-a65a427e-48c7-4507-abd4-13aaae5418fb" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-a65a427e-48c7-4507-abd4-13aaae5418fb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-quobyte-40e451f0-a486-4340-99a6-381cae4bd0b3" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-40e451f0-a486-4340-99a6-381cae4bd0b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Deleting offline snapshot 40e451f0-a486-4340-99a6-381cae4bd0b3 of volume a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:33:14 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] snapshot_file for this snap is: volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4" returned: 0 in 0.456s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb76f216-cfef-47f5-ba1b-7bf719275cd0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:14 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4 Sep 12 07:33:14 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:14 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f" returned: 0 in 0.511s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:14 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 1G Sep 12 07:33:14 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:14 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 Sep 12 07:33:14 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:14 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-63eeb2e1-210f-4cf7-85b8-59b39225c0e4" returned: 0 in 0.284s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-63eeb2e1-210f-4cf7-85b8-59b39225c0e4" released by "delete_volume" :: held 0.791s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['0aa6d61f-1660-45d8-bd7f-1b78af8bed47', '01420a00-5e96-42c1-b9f2-0bae092c1029', 'b1c109a1-0ed6-4633-9d11-f3567db59aef', '379211ab-ae10-4052-acf2-64605b3748d3'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:15 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3" returned: 0 in 0.460s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65a427e-48c7-4507-abd4-13aaae5418fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbc50d5-ddcb-4e2c-bd4d-6feb11e0264c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:15 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:15 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 1G" returned: 0 in 0.529s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4006a0b8-51b1-4f29-ac21-749c8b49439f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb Sep 12 07:33:15 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:15 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4006a0b8-51b1-4f29-ac21-749c8b49439f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 Sep 12 07:33:15 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d316148-c884-43b0-94fe-bb2466a4ccc0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.360s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleted volume successfully. Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9422ba93-fc41-49bb-bcf4-b53b3ba75887 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-63eeb2e1-210f-4cf7-85b8-59b39225c0e4-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:15 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a Sep 12 07:33:15 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:15 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4006a0b8-51b1-4f29-ac21-749c8b49439f -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6" returned: 0 in 0.498s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:15 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 is being set with open permissions: ugo+rw Sep 12 07:33:15 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb" returned: 0 in 0.637s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 Sep 12 07:33:15 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:15 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 Sep 12 07:33:15 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:15 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a" returned: 0 in 0.474s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:15 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a Sep 12 07:33:15 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:16 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6" returned: 0 in 0.315s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:16 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a" returned: 0 in 0.312s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a" released by "delete_volume" :: held 0.833s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:16 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info Sep 12 07:33:16 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:16 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3" returned: 0 in 0.458s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['264a5d4f-38e5-407f-a497-75ea03af21de', '6dfc01a8-0066-4291-8963-a9c09bd39307', '5986d353-b83a-44b9-933c-b3e4390bc3c3', 'bb61924e-af88-442e-a4cf-dba6385f5af9'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:16 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3 Sep 12 07:33:16 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-c883d0fb-7aa8-43e2-b630-5a483cf9dec4-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:16 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:16 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-c883d0fb-7aa8-43e2-b630-5a483cf9dec4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:16 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info is being set with open permissions: ugo+rw Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-c883d0fb-7aa8-43e2-b630-5a483cf9dec4" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:16 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-c883d0fb-7aa8-43e2-b630-5a483cf9dec4" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:16 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f163a-866a-4937-80cf-9dfe107c0f6f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:16 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb.40e451f0-a486-4340-99a6-381cae4bd0b3" returned: 0 in 0.488s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 Sep 12 07:33:16 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-40e451f0-a486-4340-99a6-381cae4bd0b3" released by "_delete_snapshot" :: held 2.213s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-a65a427e-48c7-4507-abd4-13aaae5418fb" released by "delete_snapshot" :: held 2.242s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:16 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.507s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:16 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Created reservations ['6abac15e-635b-47d2-a9e6-00fdf5c886d5', 'a9fa98a3-1ccc-479f-865e-f44710f23223', 'f7b6a7bf-2fc5-40b7-b12a-a71490194815', '699004b6-2968-4e28-baef-e473ccb1e21f'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleted volume successfully. Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.info" returned: 0 in 0.426s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cab25cb9-4557-455c-acc5-8a358364678f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-25bfeb45-acf7-4b7f-9b8d-5cca074aae4a-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-72e38709-32b2-45c2-a4ef-18677f69e976 tempest-VolumeDependencyTests-2124458824 None] Create snapshot completed successfully Sep 12 07:33:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Delete snapshot completed successfully. Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-b11d474b-b797-4298-94d3-ee381c40f687 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-40e451f0-a486-4340-99a6-381cae4bd0b3-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:17 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4" returned: 0 in 0.472s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:17 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4 Sep 12 07:33:17 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:17 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c883d0fb-7aa8-43e2-b630-5a483cf9dec4" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-c883d0fb-7aa8-43e2-b630-5a483cf9dec4" released by "delete_volume" :: held 0.792s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['68fe9239-ab1e-47d0-adef-b59601bc3dd5', '40860876-d5c2-42c6-849e-9c4eeb1d999f', 'b3d2ffca-69db-469b-b60e-fff49b502105', '26a56e61-633e-4936-bb93-163dcc5de8b1'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:17 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:17 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-21886218-8572-4505-9304-c1b7cc383e0e-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:17 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-21886218-8572-4505-9304-c1b7cc383e0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-db444fa9-41cb-4c20-a509-d3255590db16" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.265s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:17 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleted volume successfully. Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-db444fa9-41cb-4c20-a509-d3255590db16" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-21886218-8572-4505-9304-c1b7cc383e0e" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-21886218-8572-4505-9304-c1b7cc383e0e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleting offline snapshot 21886218-8572-4505-9304-c1b7cc383e0e of volume db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] snapshot_file for this snap is: volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-a65a427e-48c7-4507-abd4-13aaae5418fb-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7c98496d-7c4b-4481-ab03-dfc98264808b tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-c883d0fb-7aa8-43e2-b630-5a483cf9dec4-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8429a-9dc9-4c0a-a981-8effda5d048f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-a65a427e-48c7-4507-abd4-13aaae5418fb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-quobyte-a65a427e-48c7-4507-abd4-13aaae5418fb" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:17 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-a65a427e-48c7-4507-abd4-13aaae5418fb" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dda205-04db-455f-8e61-13abcff44b0f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:18 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e Sep 12 07:33:18 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:18 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb Sep 12 07:33:18 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:18 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e" returned: 0 in 0.525s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db444fa9-41cb-4c20-a509-d3255590db16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853f6ea-aed8-412e-ac73-60918e7bc760]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:18 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 Sep 12 07:33:18 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:18 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb" returned: 0 in 0.558s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:18 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb Sep 12 07:33:18 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Flow 'volume_create_manager' (72d1fcdc-c791-4e23-a747-697156d9506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573da91f-2aa0-42d5-95a7-2fb8fdde5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573da91f-2aa0-42d5-95a7-2fb8fdde5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2138981229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9567a286-830d-4192-82df-7f2373c7788b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5521b6e1da9741d486ac49dfc0517656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ac960dc-b0d4-4482-ac6b-ed629f88add6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:19Z,use_quota=True,user_id='d929cae1d6814e29bf00a1c9b70f08d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ee7c64-7aa0-4156-b109-b0c6020bfb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ee7c64-7aa0-4156-b109-b0c6020bfb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d15e08-cc0b-48d2-a943-5e4ff89ddf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d15e08-cc0b-48d2-a943-5e4ff89ddf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9567a286-830d-4192-82df-7f2373c7788b', 'volume_name': 'volume-9567a286-830d-4192-82df-7f2373c7788b', 'volume_size': 1, 'snapshot_id': '9ac960dc-b0d4-4482-ac6b-ed629f88add6'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c31165-3806-4029-856f-41a1891f9183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c31165-3806-4029-856f-41a1891f9183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede529a3-f025-49ba-8723-762c5ea7b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:18 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Volume 9567a286-830d-4192-82df-7f2373c7788b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9567a286-830d-4192-82df-7f2373c7788b', 'volume_size': 1, 'snapshot_id': '9ac960dc-b0d4-4482-ac6b-ed629f88add6'} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-quobyte-9ac960dc-b0d4-4482-ac6b-ed629f88add6-9567a286-830d-4192-82df-7f2373c7788b" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9ac960dc-b0d4-4482-ac6b-ed629f88add6-9567a286-830d-4192-82df-7f2373c7788b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Creating volume 9567a286-830d-4192-82df-7f2373c7788b from snapshot 9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-quobyte-9567a286-830d-4192-82df-7f2373c7788b" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9567a286-830d-4192-82df-7f2373c7788b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] snapshot: 9ac960dc-b0d4-4482-ac6b-ed629f88add6, volume: 9567a286-830d-4192-82df-7f2373c7788b, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:33:18 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-a65a427e-48c7-4507-abd4-13aaae5418fb" returned: 0 in 0.332s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8523d1cd-4743-4e57-a4e2-6a9dfc4dfb2c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:18 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-a65a427e-48c7-4507-abd4-13aaae5418fb" released by "delete_volume" :: held 0.982s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16" returned: 0 in 0.522s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:18 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e Sep 12 07:33:18 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Created reservations ['18aa113e-0039-45d5-9419-3071036a9186', 'f84c5504-388f-4811-82a1-41a6d9583974', 'fae98be9-604a-441f-aa5e-46ac29a4f5c3', 'e761dae4-d825-42e5-adb1-5607ab6a4e7f'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:19 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 Sep 12 07:33:19 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:19 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:19 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:19 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4006a0b8-51b1-4f29-ac21-749c8b49439f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b7aab-7d9e-4012-907b-c5b159cf90d6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:19 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e" returned: 0 in 0.461s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:19 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e Sep 12 07:33:19 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:19 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Deleted volume successfully. Sep 12 07:33:19 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f Sep 12 07:33:19 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-1345b076-1650-4c72-a812-dab0e9352ebe tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-a65a427e-48c7-4507-abd4-13aaae5418fb-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:19 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16.21886218-8572-4505-9304-c1b7cc383e0e" returned: 0 in 0.309s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-21886218-8572-4505-9304-c1b7cc383e0e" released by "_delete_snapshot" :: held 1.939s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-db444fa9-41cb-4c20-a509-d3255590db16" released by "delete_snapshot" :: held 1.977s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:19 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f" returned: 0 in 0.454s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['b86ca406-5f24-4950-a1c3-bb268bf64d77', '0ae7f998-be3b-4b1b-a74a-600ef6b2d6de', '3bab8363-704d-4a18-848e-dd61020bc398', '8f0cabad-50e1-40a9-a011-898d9d27428f'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:19 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b Sep 12 07:33:19 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Delete snapshot completed successfully. Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-7b08c124-6f6d-4fd4-8167-f803baf2ecf5 tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-21886218-8572-4505-9304-c1b7cc383e0e-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-db444fa9-41cb-4c20-a509-d3255590db16-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-db444fa9-41cb-4c20-a509-d3255590db16-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "cinder-quobyte-db444fa9-41cb-4c20-a509-d3255590db16" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-db444fa9-41cb-4c20-a509-d3255590db16" acquired by "delete_volume" :: waited 0.028s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a8353-5487-4179-8d36-07929e496f5a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-6ab658fe-4d23-477a-9587-57af5c5fd5f4-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-6ab658fe-4d23-477a-9587-57af5c5fd5f4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:20 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 Sep 12 07:33:20 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "cinder-quobyte-6ab658fe-4d23-477a-9587-57af5c5fd5f4" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-6ab658fe-4d23-477a-9587-57af5c5fd5f4" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[65672741-4f8e-48a0-8510-320cbdcba0c9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:20 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 Sep 12 07:33:20 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:20 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16" returned: 0 in 0.724s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:20 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16 Sep 12 07:33:20 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:21 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4" returned: 0 in 0.870s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:21 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4 Sep 12 07:33:21 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:21 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-db444fa9-41cb-4c20-a509-d3255590db16" returned: 0 in 0.534s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-quobyte-db444fa9-41cb-4c20-a509-d3255590db16" released by "delete_volume" :: held 1.382s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Created reservations ['8887319a-63dc-4f19-8c40-4fdb3a3db403', '7db8c1fe-6fc2-47a9-8f71-ab974a48173d', 'e4c563df-d72b-4023-9793-23352aec3d92', 'e727ffa6-e97d-4b2b-bf91-6f0f2dd7c2b6'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:21 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:21 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:21 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-6ab658fe-4d23-477a-9587-57af5c5fd5f4" returned: 0 in 0.597s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-quobyte-6ab658fe-4d23-477a-9587-57af5c5fd5f4" released by "delete_volume" :: held 1.555s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Created reservations ['5ef45a28-dec1-4e81-affd-1408bf51625d', '9f2726be-9208-45b7-88e4-b6608825c177', '7cb116d8-e794-4546-a6e5-04a473606b0c', 'b76b096e-6600-44f0-a530-c834f1eb475b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:22 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.428s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Deleted volume successfully. Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-597c27f6-b192-4ae7-93d6-34dbe82b701f tempest-CreateVolumesFromSnapshotTest-1772548765 None] Lock "cinder-db444fa9-41cb-4c20-a509-d3255590db16-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:22 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:22 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:22 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.467s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Deleted volume successfully. Sep 12 07:33:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-aa0ecd38-0b1d-4aaa-a119-abc29beb9d08 tempest-CinderUnicodeTest-1898327727 None] Lock "cinder-6ab658fe-4d23-477a-9587-57af5c5fd5f4-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:25 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b" returned: 0 in 5.993s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:25 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:33:25 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Converted 1024.00 MB image at 170.83 MB/s Sep 12 07:33:25 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b is being set with open permissions: ugo+rw Sep 12 07:33:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:25 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b Sep 12 07:33:25 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:26 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b" returned: 0 in 0.275s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9567a286-830d-4192-82df-7f2373c7788b" released by "_copy_volume_from_snapshot" :: held 7.247s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9ac960dc-b0d4-4482-ac6b-ed629f88add6-9567a286-830d-4192-82df-7f2373c7788b" released by "_create_volume_from_snapshot" :: held 7.330s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.345s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede529a3-f025-49ba-8723-762c5ea7b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9567a286-830d-4192-82df-7f2373c7788b', 'volume_size': 1, 'snapshot_id': '9ac960dc-b0d4-4482-ac6b-ed629f88add6'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bcb311-4d97-42de-8baa-e605be49ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:26 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Volume volume-9567a286-830d-4192-82df-7f2373c7788b (9567a286-830d-4192-82df-7f2373c7788b): created successfully Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bcb311-4d97-42de-8baa-e605be49ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Flow 'volume_create_manager' (72d1fcdc-c791-4e23-a747-697156d9506a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:26 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-adb71e30-81a9-4e42-8bd5-afcc2f184a3e tempest-VolumeDependencyTests-2124458824 None] Created volume successfully. Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-9ac960dc-b0d4-4482-ac6b-ed629f88add6-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-9ac960dc-b0d4-4482-ac6b-ed629f88add6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-quobyte-4006a0b8-51b1-4f29-ac21-749c8b49439f" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-4006a0b8-51b1-4f29-ac21-749c8b49439f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-quobyte-9ac960dc-b0d4-4482-ac6b-ed629f88add6" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9ac960dc-b0d4-4482-ac6b-ed629f88add6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Deleting offline snapshot 9ac960dc-b0d4-4482-ac6b-ed629f88add6 of volume 4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] snapshot_file for this snap is: volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec2d35c-07a2-4cd2-8600-0740dca8011b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:26 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 Sep 12 07:33:26 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:27 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6" returned: 0 in 0.514s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:27 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4006a0b8-51b1-4f29-ac21-749c8b49439f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f3fc6-995f-4a98-9aac-3c689f949986]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:27 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f Sep 12 07:33:27 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:27 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f" returned: 0 in 0.635s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:27 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 Sep 12 07:33:27 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:28 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6" returned: 0 in 0.434s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:28 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6 Sep 12 07:33:28 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:28 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f.9ac960dc-b0d4-4482-ac6b-ed629f88add6" returned: 0 in 0.381s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9ac960dc-b0d4-4482-ac6b-ed629f88add6" released by "_delete_snapshot" :: held 2.116s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-4006a0b8-51b1-4f29-ac21-749c8b49439f" released by "delete_snapshot" :: held 2.147s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:28 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Created reservations ['b00b3726-d7c3-46e4-99a7-beabb6c6bd17', '5a8dd0f9-d614-48da-96f2-52b733fe97bc', '5a2dfc9b-4beb-4b51-9379-03c527e30f50', '8c667748-15bd-482d-83bb-fef6b8908b02'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Delete snapshot completed successfully. Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-82ad4111-9c25-43c8-86a9-f21501c07211 tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-9ac960dc-b0d4-4482-ac6b-ed629f88add6-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (3d5ab07c-2193-4a27-8ae3-1c1868dee6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16614dab-e1a3-48cb-b4e5-a09c9526dfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16614dab-e1a3-48cb-b4e5-a09c9526dfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709210047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da936cb3-2997-4116-a262-eecd1d977c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:29Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b75d02f-0541-4216-b463-dc452c9a30e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b75d02f-0541-4216-b463-dc452c9a30e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdcb1a7-f51f-4467-a84a-d3f362f652fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdcb1a7-f51f-4467-a84a-d3f362f652fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da936cb3-2997-4116-a262-eecd1d977c22', 'volume_name': 'volume-da936cb3-2997-4116-a262-eecd1d977c22', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77351cb9-2448-4bf8-9b00-1ac026005c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77351cb9-2448-4bf8-9b00-1ac026005c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcc76cc-0963-4db4-9710-d91d358ff913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:29 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Volume da936cb3-2997-4116-a262-eecd1d977c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da936cb3-2997-4116-a262-eecd1d977c22', 'volume_size': 1} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709210047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da936cb3-2997-4116-a262-eecd1d977c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:29Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Creating volume da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:29 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:29 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 1073741824 Sep 12 07:33:29 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-4006a0b8-51b1-4f29-ac21-749c8b49439f-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-4006a0b8-51b1-4f29-ac21-749c8b49439f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-quobyte-4006a0b8-51b1-4f29-ac21-749c8b49439f" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-4006a0b8-51b1-4f29-ac21-749c8b49439f" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d210500-4fea-49bb-90b7-32564ef83a95]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:30 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 1073741824" returned: 0 in 0.623s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:30 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 Sep 12 07:33:30 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:30 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f Sep 12 07:33:30 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:30 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:30 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:30 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22" returned: 0 in 0.297s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcc76cc-0963-4db4-9710-d91d358ff913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da936cb3-2997-4116-a262-eecd1d977c22', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf4319-45c6-4557-8640-27013b37df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:30 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Volume volume-da936cb3-2997-4116-a262-eecd1d977c22 (da936cb3-2997-4116-a262-eecd1d977c22): created successfully Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf4319-45c6-4557-8640-27013b37df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (3d5ab07c-2193-4a27-8ae3-1c1868dee6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0f4198b7-9c48-4d15-bd38-db5cf6dee1b5 tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:33:30 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f" returned: 0 in 0.556s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:30 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.369s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:33:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:33:30 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f Sep 12 07:33:30 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:31 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4006a0b8-51b1-4f29-ac21-749c8b49439f" returned: 0 in 0.287s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-4006a0b8-51b1-4f29-ac21-749c8b49439f" released by "delete_volume" :: held 0.940s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Created reservations ['f5253e1b-382a-49ea-866c-afed3334ec0d', '12c6f914-35c5-4539-861b-a1f623f4ad89', '3c554096-55a9-4d0c-bcb7-8251117a0e9b', '2b783e44-e378-4d06-8f05-9830fb61b9ca'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:31 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:31 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:31 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.333s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:31 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Deleted volume successfully. Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-74914d73-35bb-4f9d-903e-a73bf786646f tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-4006a0b8-51b1-4f29-ac21-749c8b49439f-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot 16765548-6857-4c04-aafe-e16274bca538 of volume da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be2569d-0a5b-4553-8666-3600714eb1cb]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:32 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 Sep 12 07:33:32 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-9567a286-830d-4192-82df-7f2373c7788b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-9567a286-830d-4192-82df-7f2373c7788b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "cinder-quobyte-9567a286-830d-4192-82df-7f2373c7788b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9567a286-830d-4192-82df-7f2373c7788b" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:32 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22" returned: 0 in 0.453s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3fe771-f19d-4334-9cf1-975fa8813dbf]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:32 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 1G Sep 12 07:33:32 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:32 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b Sep 12 07:33:32 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:32 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 1G" returned: 0 in 0.504s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da936cb3-2997-4116-a262-eecd1d977c22 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:32 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b" returned: 0 in 0.512s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:33 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da936cb3-2997-4116-a262-eecd1d977c22 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 Sep 12 07:33:33 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:33 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b Sep 12 07:33:33 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:33 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:33 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-9567a286-830d-4192-82df-7f2373c7788b" returned: 0 in 0.380s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da936cb3-2997-4116-a262-eecd1d977c22 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538" returned: 0 in 0.416s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:33 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 is being set with open permissions: ugo+rw Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-quobyte-9567a286-830d-4192-82df-7f2373c7788b" released by "delete_volume" :: held 0.962s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:33 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 Sep 12 07:33:33 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Created reservations ['5d3962e1-f5ab-49c7-8378-c88f9497893b', '66728105-afec-4db5-856a-a31ef62cc022', '58676d7d-859a-448b-ba4e-dd40c6b3be37', '87694db0-e83f-46c0-bab9-cfa801a51611'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:33 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:33 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:33 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538" returned: 0 in 0.406s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:33 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info Sep 12 07:33:33 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:33 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.308s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Deleted volume successfully. Sep 12 07:33:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-f0daf685-acb2-4a43-adc1-581d6e43093b tempest-VolumeDependencyTests-2124458824 None] Lock "cinder-9567a286-830d-4192-82df-7f2373c7788b-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:34 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info" returned: 0 in 0.316s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:34 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info is being set with open permissions: ugo+rw Sep 12 07:33:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:34 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info Sep 12 07:33:34 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:34 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.info" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b530a21d-4bb0-4469-b649-6914860da53e tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-16765548-6857-4c04-aafe-e16274bca538-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-16765548-6857-4c04-aafe-e16274bca538-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-da936cb3-2997-4116-a262-eecd1d977c22" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-da936cb3-2997-4116-a262-eecd1d977c22" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-16765548-6857-4c04-aafe-e16274bca538" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-16765548-6857-4c04-aafe-e16274bca538" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot 16765548-6857-4c04-aafe-e16274bca538 of volume da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef27b00-d8ed-42a1-818a-3c49a25de401]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:35 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 Sep 12 07:33:35 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:35 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538" returned: 0 in 0.595s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da936cb3-2997-4116-a262-eecd1d977c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e4050-0746-4380-b9ae-a75b6d6b9297]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:36 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 Sep 12 07:33:36 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:36 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22" returned: 0 in 0.500s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:36 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 Sep 12 07:33:36 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:36 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538" returned: 0 in 0.525s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:37 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538 Sep 12 07:33:37 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:37 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22.16765548-6857-4c04-aafe-e16274bca538" returned: 0 in 0.318s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-16765548-6857-4c04-aafe-e16274bca538" released by "_delete_snapshot" :: held 2.110s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-da936cb3-2997-4116-a262-eecd1d977c22" released by "delete_snapshot" :: held 2.152s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:37 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Created reservations ['c1946f18-0b90-43d6-93f3-08a8e841f170', 'dc59c312-e6b8-4e68-927c-4d2044545259', 'cd101a6a-3516-4327-b019-9a804cb359e8', '90b9b4cb-d6d7-40bb-877b-f7ca7392416f'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:33:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-668bd0d0-5364-4f02-b786-4051a1fe3b8c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-16765548-6857-4c04-aafe-e16274bca538-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-da936cb3-2997-4116-a262-eecd1d977c22-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Lock "cinder-da936cb3-2997-4116-a262-eecd1d977c22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-da936cb3-2997-4116-a262-eecd1d977c22" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:38 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-da936cb3-2997-4116-a262-eecd1d977c22" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:38 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6464437d-78c7-4dd5-92c7-c3f5b0087e54]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:38 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 Sep 12 07:33:38 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:39 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:39 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22 Sep 12 07:33:39 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:39 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-da936cb3-2997-4116-a262-eecd1d977c22" returned: 0 in 0.294s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-da936cb3-2997-4116-a262-eecd1d977c22" released by "delete_volume" :: held 0.783s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Created reservations ['38ab9d45-3c81-45bd-9ed6-62a9504aa5a4', '1df4c954-e03c-4de2-9371-8cece56cd60b', '99fdaaee-af26-455a-ba28-5aea01b782b8', '4930df26-15e1-4988-8c67-e2a7d97d4851'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:39 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:39 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:39 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:39 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:33:39 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ef82d0b0-96d0-4311-8f9c-75d7791b7b8d tempest-ProjectMemberTests-1258291113 None] Lock "cinder-da936cb3-2997-4116-a262-eecd1d977c22-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4697e3a9-e156-49d7-89d1-e0bae8386e37 tempest-ProjectAdminTests-927639216 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1816902160645, 'free_capacity_gb': 1773.1816902160645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88013) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (ea170abc-467b-4d85-8295-7bb258ea53ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b056db3a-e15f-490b-8f06-c7f02804602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b056db3a-e15f-490b-8f06-c7f02804602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467470493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22af644-0a33-4d9e-839e-9d8958ed74b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:40Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7709eab-f676-4457-8088-8b38f5095473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7709eab-f676-4457-8088-8b38f5095473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ae350c-ee85-4720-b81e-3189984b2aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ae350c-ee85-4720-b81e-3189984b2aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22af644-0a33-4d9e-839e-9d8958ed74b1', 'volume_name': 'volume-e22af644-0a33-4d9e-839e-9d8958ed74b1', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c3faf-1405-4ac9-8a9b-13b76e782310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c3faf-1405-4ac9-8a9b-13b76e782310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56eb2fdb-7d0c-49f3-887a-2677af76c0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:40 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Volume e22af644-0a33-4d9e-839e-9d8958ed74b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22af644-0a33-4d9e-839e-9d8958ed74b1', 'volume_size': 1} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467470493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22af644-0a33-4d9e-839e-9d8958ed74b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:40Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Creating volume e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:40 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:40 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 1073741824 Sep 12 07:33:40 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:41 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 1073741824" returned: 0 in 0.523s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:41 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 Sep 12 07:33:41 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:41 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1" returned: 0 in 0.358s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56eb2fdb-7d0c-49f3-887a-2677af76c0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22af644-0a33-4d9e-839e-9d8958ed74b1', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3da1d0-a721-470b-824a-6c6b87942556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:41 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Volume volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 (e22af644-0a33-4d9e-839e-9d8958ed74b1): created successfully Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3da1d0-a721-470b-824a-6c6b87942556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:41 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (ea170abc-467b-4d85-8295-7bb258ea53ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1a8e41bb-e412-4db7-bf5e-3907342bccce tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:33:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:42 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot bc6e9f17-9c71-4988-bdf3-995480e346d5 of volume e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e5171-f658-4be9-85e1-183652f12034]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:43 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 Sep 12 07:33:43 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:43 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1" returned: 0 in 0.482s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:43 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 1G Sep 12 07:33:43 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:43 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 1G" returned: 0 in 0.563s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:43 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 Sep 12 07:33:43 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:44 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5" returned: 0 in 0.392s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:44 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 is being set with open permissions: ugo+rw Sep 12 07:33:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:44 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 Sep 12 07:33:44 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:44 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5" returned: 0 in 0.408s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:44 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info Sep 12 07:33:44 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:45 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info" returned: 0 in 0.320s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:45 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info is being set with open permissions: ugo+rw Sep 12 07:33:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:45 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info Sep 12 07:33:45 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:45 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.info" returned: 0 in 0.325s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:45 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d34aedbb-c0bb-41e3-9a72-8f3ee4c28d72 tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-bc6e9f17-9c71-4988-bdf3-995480e346d5-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-bc6e9f17-9c71-4988-bdf3-995480e346d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-e22af644-0a33-4d9e-839e-9d8958ed74b1" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-e22af644-0a33-4d9e-839e-9d8958ed74b1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-bc6e9f17-9c71-4988-bdf3-995480e346d5" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-bc6e9f17-9c71-4988-bdf3-995480e346d5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot bc6e9f17-9c71-4988-bdf3-995480e346d5 of volume e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bfc421-c561-435f-aaea-eb185de4baed]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:46 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 Sep 12 07:33:46 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:46 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5" returned: 0 in 0.483s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e22af644-0a33-4d9e-839e-9d8958ed74b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c95fb3-0e0c-4102-ab3c-b58c5a835314]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:46 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 Sep 12 07:33:46 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:47 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1" returned: 0 in 0.472s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:47 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 Sep 12 07:33:47 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:47 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5" returned: 0 in 0.417s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:47 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5 Sep 12 07:33:47 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:47 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1.bc6e9f17-9c71-4988-bdf3-995480e346d5" returned: 0 in 0.363s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-bc6e9f17-9c71-4988-bdf3-995480e346d5" released by "_delete_snapshot" :: held 1.974s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-e22af644-0a33-4d9e-839e-9d8958ed74b1" released by "delete_snapshot" :: held 2.021s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:48 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Created reservations ['b0e174d6-80fa-4dd1-bb7a-bfefe4c94c73', 'e4e9eda0-390b-4f19-aa00-52bf0e64897b', 'bf2bd92f-f48f-4d0a-ab4c-4010bd8aa05d', 'ac4b80e3-bfbc-4f57-9914-e7aef6b9dbec'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:33:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-62c3ee38-47a8-4b22-866b-81754b816dc9 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-bc6e9f17-9c71-4988-bdf3-995480e346d5-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-e22af644-0a33-4d9e-839e-9d8958ed74b1-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-e22af644-0a33-4d9e-839e-9d8958ed74b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-e22af644-0a33-4d9e-839e-9d8958ed74b1" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-e22af644-0a33-4d9e-839e-9d8958ed74b1" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b9462-bc5c-441f-9eb3-a3bd0e4c4b7d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Flow 'volume_create_manager' (853ca324-7a1e-46cd-a10a-632d2f62c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2dbca9-f6d1-47eb-914b-705eaf5f551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2dbca9-f6d1-47eb-914b-705eaf5f551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1560533750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad82c851-a353-46ed-b08e-5b343024bbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dfad3fdb5a4a0dabca61ab69d94737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:50Z,use_quota=True,user_id='8dee172ea7064cc4837f4c10a09b354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50f8e4c-907f-41fa-8f1c-208f6e53d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:49 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 Sep 12 07:33:49 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50f8e4c-907f-41fa-8f1c-208f6e53d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc9617c-b702-4668-b436-0bb4a0732d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc9617c-b702-4668-b436-0bb4a0732d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad82c851-a353-46ed-b08e-5b343024bbeb', 'volume_name': 'volume-ad82c851-a353-46ed-b08e-5b343024bbeb', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f258e757-58fa-4730-843a-162ec887ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f258e757-58fa-4730-843a-162ec887ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497d7fc2-9582-411e-b03b-683bb6fc76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:49 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Volume ad82c851-a353-46ed-b08e-5b343024bbeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad82c851-a353-46ed-b08e-5b343024bbeb', 'volume_size': 1} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1560533750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad82c851-a353-46ed-b08e-5b343024bbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dfad3fdb5a4a0dabca61ab69d94737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:50Z,use_quota=True,user_id='8dee172ea7064cc4837f4c10a09b354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Creating volume ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:49 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:49 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb 1073741824 Sep 12 07:33:49 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:49 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1" returned: 0 in 0.425s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:49 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1 Sep 12 07:33:49 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:50 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:50 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb 1073741824" returned: 0 in 0.591s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-e22af644-0a33-4d9e-839e-9d8958ed74b1" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (b0cec190-031f-473a-8069-6137df37e645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618c3903-fbd1-419b-8297-cf4070721c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-e22af644-0a33-4d9e-839e-9d8958ed74b1" released by "delete_volume" :: held 0.876s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618c3903-fbd1-419b-8297-cf4070721c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122262405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ede7094-bcc7-4e98-ae55-1ed00f522ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:50Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995a7737-d382-4b0d-804b-40563044ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995a7737-d382-4b0d-804b-40563044ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5863d75-7ea9-4969-a29b-b7cf8fff250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5863d75-7ea9-4969-a29b-b7cf8fff250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ede7094-bcc7-4e98-ae55-1ed00f522ac8', 'volume_name': 'volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd6bd31-0820-4aa1-b6a5-c9220bf7e3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd6bd31-0820-4aa1-b6a5-c9220bf7e3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9c5cc2-e60c-4dca-ba70-b8c38ccdeb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:50 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Volume 3ede7094-bcc7-4e98-ae55-1ed00f522ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8', 'volume_size': 1} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:50 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb Sep 12 07:33:50 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Created reservations ['7a2f1263-50fb-482f-9910-f0e68d7b12b3', 'fcf4ea65-fd71-45da-b2cd-51b26b002d79', '11459d8c-9c4a-4a26-905d-b6cd30772aa5', '045cd2d5-bfec-427f-906e-0a8af2e79a81'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:50 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:50 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:50 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb" returned: 0 in 0.331s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122262405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ede7094-bcc7-4e98-ae55-1ed00f522ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:50Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Creating volume 3ede7094-bcc7-4e98-ae55-1ed00f522ac8 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:50 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:50 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 1073741824 Sep 12 07:33:50 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497d7fc2-9582-411e-b03b-683bb6fc76d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad82c851-a353-46ed-b08e-5b343024bbeb', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31252de9-c829-4521-aa30-00a3fef811e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:50 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Volume volume-ad82c851-a353-46ed-b08e-5b343024bbeb (ad82c851-a353-46ed-b08e-5b343024bbeb): created successfully Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31252de9-c829-4521-aa30-00a3fef811e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Flow 'volume_create_manager' (853ca324-7a1e-46cd-a10a-632d2f62c278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1d2a619b-204e-4657-824a-16bac08e79f9 tempest-SnapshotDependencyTests-253553111 None] Created volume successfully. Sep 12 07:33:50 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:33:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-37aaa177-ca64-47ec-b7fc-17362ca6daf2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-e22af644-0a33-4d9e-839e-9d8958ed74b1-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (e3836cfb-cb57-4ffc-970c-eff902b1fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50cf905-b7de-4829-86e2-14a3dbeb3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50cf905-b7de-4829-86e2-14a3dbeb3246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566276107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab6dd65-08f0-4d0a-a395-8bfb15112525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:51Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dc6d4a-cc4b-4346-8d69-1dfede1fbeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dc6d4a-cc4b-4346-8d69-1dfede1fbeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587b2b44-77b7-4aa5-9f5e-37f9aac1ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587b2b44-77b7-4aa5-9f5e-37f9aac1ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab6dd65-08f0-4d0a-a395-8bfb15112525', 'volume_name': 'volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72252a1-6270-4a98-88f2-86599bc9975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72252a1-6270-4a98-88f2-86599bc9975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b4f15-12da-40c3-b9c1-57676cb234c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:51 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Volume 5ab6dd65-08f0-4d0a-a395-8bfb15112525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525', 'volume_size': 1} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:51 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 1073741824" returned: 0 in 0.568s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:51 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 Sep 12 07:33:51 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:51 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566276107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab6dd65-08f0-4d0a-a395-8bfb15112525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:51Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Creating volume 5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:51 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9c5cc2-e60c-4dca-ba70-b8c38ccdeb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef99bfd1-eb4f-450b-ba28-b964ad8a7348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:51 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 1073741824 Sep 12 07:33:51 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:51 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Volume volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 (3ede7094-bcc7-4e98-ae55-1ed00f522ac8): created successfully Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef99bfd1-eb4f-450b-ba28-b964ad8a7348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (b0cec190-031f-473a-8069-6137df37e645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:51 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-36628307-7e9e-4213-b447-8f33d2266789 tempest-ProjectReaderTests-1206862359 None] Created volume successfully. Sep 12 07:33:51 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:52 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 1073741824" returned: 0 in 0.546s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:52 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 Sep 12 07:33:52 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:52 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.589s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b4f15-12da-40c3-b9c1-57676cb234c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0440e4-3355-4a04-95d5-d0230cc68730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Creating offline snapshot e871d0b1-b409-4b64-bbaf-d311b2338790 of volume ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:52 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Volume volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 (5ab6dd65-08f0-4d0a-a395-8bfb15112525): created successfully Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0440e4-3355-4a04-95d5-d0230cc68730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (e3836cfb-cb57-4ffc-970c-eff902b1fc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb3bc8-50e2-4f68-a8d6-42b7f3975c51]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:52 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f3fb7571-28a0-4556-b961-497e75c0bdbf tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:33:52 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb Sep 12 07:33:52 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-3ede7094-bcc7-4e98-ae55-1ed00f522ac8-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-3ede7094-bcc7-4e98-ae55-1ed00f522ac8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-quobyte-3ede7094-bcc7-4e98-ae55-1ed00f522ac8" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-3ede7094-bcc7-4e98-ae55-1ed00f522ac8" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a64e7f-0aca-42d1-aad1-bee0bac74aba]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:52 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:53 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb" returned: 0 in 0.435s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:53 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 Sep 12 07:33:53 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:53 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 1G Sep 12 07:33:53 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:53 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8" returned: 0 in 0.440s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:53 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8 Sep 12 07:33:53 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:53 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 1G" returned: 0 in 0.482s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad82c851-a353-46ed-b08e-5b343024bbeb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:53 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad82c851-a353-46ed-b08e-5b343024bbeb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 Sep 12 07:33:53 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:53 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3ede7094-bcc7-4e98-ae55-1ed00f522ac8" returned: 0 in 0.281s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-3ede7094-bcc7-4e98-ae55-1ed00f522ac8" released by "delete_volume" :: held 0.772s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Created reservations ['ad3ec3bd-5c22-40d9-8f28-fde60046855b', 'ee0a8300-a610-4b33-b464-5ab71ceb279c', 'eac2dea6-b542-46b9-ac2f-509008aba430', '6949531b-dace-4181-b379-905da8752264'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:53 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:33:53 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:53 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad82c851-a353-46ed-b08e-5b343024bbeb -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790" returned: 0 in 0.323s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:53 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 is being set with open permissions: ugo+rw Sep 12 07:33:53 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:53 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 Sep 12 07:33:53 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:54 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.285s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:33:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Deleted volume successfully. Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8c589738-8634-4bd5-9913-e03284fd3965 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-3ede7094-bcc7-4e98-ae55-1ed00f522ac8-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:33:54 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790" returned: 0 in 0.319s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:54 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info Sep 12 07:33:54 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (96b76acb-19fd-4ff7-8e1a-bac053a4b52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92469e62-2d52-4229-bb1d-a964b93b9e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:54 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info" returned: 0 in 0.300s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:54 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info is being set with open permissions: ugo+rw Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:54 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92469e62-2d52-4229-bb1d-a964b93b9e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597890713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08843ba6-11de-45fd-807c-178531e2f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:54Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:54 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a870b626-52ba-42f6-af00-175a2c268294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a870b626-52ba-42f6-af00-175a2c268294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9569ebf0-9270-4d14-92db-9427c8317aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9569ebf0-9270-4d14-92db-9427c8317aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08843ba6-11de-45fd-807c-178531e2f7f0', 'volume_name': 'volume-08843ba6-11de-45fd-807c-178531e2f7f0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086abc7e-dbe5-47ba-b0d5-7c09cdc99f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086abc7e-dbe5-47ba-b0d5-7c09cdc99f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e675387-bcad-4e9c-9a51-a40cf42a0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Volume 08843ba6-11de-45fd-807c-178531e2f7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08843ba6-11de-45fd-807c-178531e2f7f0', 'volume_size': 1} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:54 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.info" returned: 0 in 0.278s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.376s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot f55b9694-473f-4758-ac8f-0b86866c1ca2 of volume 5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:33:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-136b1b0c-cd0e-4c1d-a06b-945184b79b11 tempest-SnapshotDependencyTests-253553111 None] Create snapshot completed successfully Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[849213b2-593d-4636-ba9c-4925c1b5fce5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:54 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 Sep 12 07:33:54 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:55 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525" returned: 0 in 0.377s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:55 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 1G Sep 12 07:33:55 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:55 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 1G" returned: 0 in 0.498s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:55 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 Sep 12 07:33:55 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Flow 'volume_create_manager' (39dca398-053f-4db0-b351-39db53e23daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aba02e6-aac6-4d35-9689-5d785bde0f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aba02e6-aac6-4d35-9689-5d785bde0f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e265499-3812-484b-b279-0f8d272bf7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dfad3fdb5a4a0dabca61ab69d94737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e871d0b1-b409-4b64-bbaf-d311b2338790,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:56Z,use_quota=True,user_id='8dee172ea7064cc4837f4c10a09b354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e1a606-11d4-4fca-b6f1-12c93b981b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e1a606-11d4-4fca-b6f1-12c93b981b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1acea3-2c7d-4e07-9c84-ab95c7ef5596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1acea3-2c7d-4e07-9c84-ab95c7ef5596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e265499-3812-484b-b279-0f8d272bf7ca', 'volume_name': 'volume-4e265499-3812-484b-b279-0f8d272bf7ca', 'volume_size': 1, 'snapshot_id': 'e871d0b1-b409-4b64-bbaf-d311b2338790'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9fd71c-c1e3-4eff-ac68-58c1829783bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9fd71c-c1e3-4eff-ac68-58c1829783bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d9eaae-39a8-4f40-87f5-7db89cd869e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:55 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Volume 4e265499-3812-484b-b279-0f8d272bf7ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e265499-3812-484b-b279-0f8d272bf7ca', 'volume_size': 1, 'snapshot_id': 'e871d0b1-b409-4b64-bbaf-d311b2338790'} Sep 12 07:33:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:56 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2" returned: 0 in 0.301s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:56 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 is being set with open permissions: ugo+rw Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:56 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 Sep 12 07:33:56 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:56 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:56 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info Sep 12 07:33:56 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:56 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info" returned: 0 in 0.283s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:56 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info is being set with open permissions: ugo+rw Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:56 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info Sep 12 07:33:56 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:56 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.info" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.277s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597890713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08843ba6-11de-45fd-807c-178531e2f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:33:54Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Creating volume 08843ba6-11de-45fd-807c-178531e2f7f0 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:56 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:33:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:56 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 1073741824 Sep 12 07:33:56 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:56 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-0baa82c6-5024-46e2-b13a-5a83e1dd4b4a tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:33:57 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 1073741824" returned: 0 in 0.460s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:57 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 Sep 12 07:33:57 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:57 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.665s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-quobyte-e871d0b1-b409-4b64-bbaf-d311b2338790-4e265499-3812-484b-b279-0f8d272bf7ca" by "_create_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e675387-bcad-4e9c-9a51-a40cf42a0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08843ba6-11de-45fd-807c-178531e2f7f0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd28e146-0c90-474f-95d0-b0c7568ccbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-e871d0b1-b409-4b64-bbaf-d311b2338790-4e265499-3812-484b-b279-0f8d272bf7ca" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Creating volume 4e265499-3812-484b-b279-0f8d272bf7ca from snapshot e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-quobyte-4e265499-3812-484b-b279-0f8d272bf7ca" by "_copy_volume_from_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:57 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Volume volume-08843ba6-11de-45fd-807c-178531e2f7f0 (08843ba6-11de-45fd-807c-178531e2f7f0): created successfully Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd28e146-0c90-474f-95d0-b0c7568ccbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (96b76acb-19fd-4ff7-8e1a-bac053a4b52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-4e265499-3812-484b-b279-0f8d272bf7ca" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] snapshot: e871d0b1-b409-4b64-bbaf-d311b2338790, volume: 4e265499-3812-484b-b279-0f8d272bf7ca, {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 12 07:33:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-94d244c1-6d61-49a2-b439-8acbf26d0c48 tempest-ProjectReaderTests-1206862359 None] Created volume successfully. Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-f55b9694-473f-4758-ac8f-0b86866c1ca2-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-f55b9694-473f-4758-ac8f-0b86866c1ca2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-5ab6dd65-08f0-4d0a-a395-8bfb15112525" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c7785-84a3-421c-bf43-7bd50dacee68]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-5ab6dd65-08f0-4d0a-a395-8bfb15112525" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-f55b9694-473f-4758-ac8f-0b86866c1ca2" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-f55b9694-473f-4758-ac8f-0b86866c1ca2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot f55b9694-473f-4758-ac8f-0b86866c1ca2 of volume 5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c80043f-4e97-44a1-ba2b-058eaa2f2b65]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:57 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 Sep 12 07:33:57 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:58 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 Sep 12 07:33:58 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:58 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790" returned: 0 in 0.450s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad82c851-a353-46ed-b08e-5b343024bbeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[09155739-051d-42ad-8dea-65a077841eda]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:58 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2" returned: 0 in 0.415s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[446024e2-d8f7-433c-bc27-9a1a4a0075e2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:58 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb Sep 12 07:33:58 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:58 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 Sep 12 07:33:58 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:58 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb" returned: 0 in 0.394s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Creating direct copy from snapshot {{(pid=88013) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.utils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Path /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca not found in is_blk_device check {{(pid=88013) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:58 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca Sep 12 07:33:58 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:58 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-08843ba6-11de-45fd-807c-178531e2f7f0-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525" returned: 0 in 0.473s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Lock "cinder-08843ba6-11de-45fd-807c-178531e2f7f0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:58 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 Sep 12 07:33:58 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-quobyte-08843ba6-11de-45fd-807c-178531e2f7f0" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-08843ba6-11de-45fd-807c-178531e2f7f0" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e7a1d-e85d-4a2e-92fb-6bcfc3c5f107]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:33:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:59 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 Sep 12 07:33:59 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:59 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2" returned: 0 in 0.616s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:59 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2 Sep 12 07:33:59 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:59 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0" returned: 0 in 0.571s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:33:59 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0 Sep 12 07:33:59 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:33:59 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 12 07:33:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525.f55b9694-473f-4758-ac8f-0b86866c1ca2" returned: 0 in 0.408s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:33:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-f55b9694-473f-4758-ac8f-0b86866c1ca2" released by "_delete_snapshot" :: held 2.115s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-5ab6dd65-08f0-4d0a-a395-8bfb15112525" released by "delete_snapshot" :: held 2.164s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Created reservations ['244a6ab9-416d-486f-abab-abf46da9d893', 'a021b325-7131-4ae4-b22e-dff6f6723b76', '3d84e95c-a3ce-42b9-9486-6f31690e86c3', '6d0732dc-0ae5-44e2-bf08-1998b67ae60b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:00 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-08843ba6-11de-45fd-807c-178531e2f7f0" returned: 0 in 0.705s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-08843ba6-11de-45fd-807c-178531e2f7f0" released by "delete_volume" :: held 1.378s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9c023b81-a5e0-41da-8528-28b9c3e2aef1 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-f55b9694-473f-4758-ac8f-0b86866c1ca2-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Created reservations ['d6b47620-c9c8-4913-8abe-c4e0d2ef406a', '0a5f03fb-3067-4b07-88fd-68bf9e7c4d26', '30505fe0-3fa3-4cfc-959a-1b313bfa4a9a', '341c19a6-0e70-47d7-8b52-7f012803d2ca'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:00 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:00 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:01 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:01 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Deleted volume successfully. Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-000efb61-29cb-45ac-91fc-96f31d22ae5f tempest-ProjectReaderTests-1206862359 None] Lock "cinder-08843ba6-11de-45fd-807c-178531e2f7f0-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-5ab6dd65-08f0-4d0a-a395-8bfb15112525-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-5ab6dd65-08f0-4d0a-a395-8bfb15112525-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-5ab6dd65-08f0-4d0a-a395-8bfb15112525" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-5ab6dd65-08f0-4d0a-a395-8bfb15112525" acquired by "delete_volume" :: waited 0.053s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbc7bf-15bf-4d33-b602-929ef6b84bba]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:02 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 Sep 12 07:34:02 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (ca7176ea-5c1c-46e2-8865-a2caa3c64259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bc55ba-b0b7-4337-b331-fe746d41d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bc55ba-b0b7-4337-b331-fe746d41d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-618151219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5921253d-2580-4f26-a569-01bbc14c101c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:02Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0a455f-09ac-4fa7-9927-25d3c4a371c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0a455f-09ac-4fa7-9927-25d3c4a371c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36a7190-044c-48b7-9531-cfedceb9f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36a7190-044c-48b7-9531-cfedceb9f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5921253d-2580-4f26-a569-01bbc14c101c', 'volume_name': 'volume-5921253d-2580-4f26-a569-01bbc14c101c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8003b5d8-e7d0-4a30-ac73-5c2d9a0e27ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8003b5d8-e7d0-4a30-ac73-5c2d9a0e27ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70226722-c7ce-48cd-bb01-dcc767c8d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:02 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Volume 5921253d-2580-4f26-a569-01bbc14c101c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5921253d-2580-4f26-a569-01bbc14c101c', 'volume_size': 1} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:02 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525" returned: 0 in 1.310s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:02 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525 Sep 12 07:34:02 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:03 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5ab6dd65-08f0-4d0a-a395-8bfb15112525" returned: 0 in 0.718s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:03 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-5ab6dd65-08f0-4d0a-a395-8bfb15112525" released by "delete_volume" :: held 2.208s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:03 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=146,cinder:DELETE=18,cinder:INSERT=57,cinder:UPDATE=195 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:34:03 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Created reservations ['81eceada-0be9-42d0-bb54-00716d18b3b1', '82c52d4d-4d0e-4215-a121-2121eaf7c3e6', 'e9cd4c4e-08c0-4344-b697-e7140fb3ff0d', 'a6c5d666-1c1e-4db7-8822-0472975385f8'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:03 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=208,cinder:DELETE=18,cinder:SELECT=171,cinder:INSERT=45 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:04 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:04 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:04 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.434s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:04 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca" returned: 0 in 5.822s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.image.image_utils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Image conversion details: src /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca {{(pid=88013) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 12 07:34:04 devstack cinder-volume[88013]: INFO cinder.image.image_utils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Converted 1024.00 MB image at 175.82 MB/s Sep 12 07:34:04 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca is being set with open permissions: ugo+rw Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:04 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca Sep 12 07:34:04 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-523eabe2-45c0-40a8-8f9e-d195b6f33329 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-5ab6dd65-08f0-4d0a-a395-8bfb15112525-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:04 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-4e265499-3812-484b-b279-0f8d272bf7ca" released by "_copy_volume_from_snapshot" :: held 7.046s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-e871d0b1-b409-4b64-bbaf-d311b2338790-4e265499-3812-484b-b279-0f8d272bf7ca" released by "_create_volume_from_snapshot" :: held 7.137s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.174s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-618151219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5921253d-2580-4f26-a569-01bbc14c101c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:02Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Creating volume 5921253d-2580-4f26-a569-01bbc14c101c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:04 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:04 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c 1073741824 Sep 12 07:34:04 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d9eaae-39a8-4f40-87f5-7db89cd869e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e265499-3812-484b-b279-0f8d272bf7ca', 'volume_size': 1, 'snapshot_id': 'e871d0b1-b409-4b64-bbaf-d311b2338790'}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7297ec6a-ce52-4852-9e0e-de15c7a73c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:04 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Volume volume-4e265499-3812-484b-b279-0f8d272bf7ca (4e265499-3812-484b-b279-0f8d272bf7ca): created successfully Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7297ec6a-ce52-4852-9e0e-de15c7a73c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:04 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Flow 'volume_create_manager' (39dca398-053f-4db0-b351-39db53e23daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2be92dde-9b49-4515-bd6b-137a4994e016 tempest-SnapshotDependencyTests-253553111 None] Created volume successfully. Sep 12 07:34:05 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c 1073741824" returned: 0 in 0.559s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:05 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c Sep 12 07:34:05 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (b62b2f42-3088-41e6-bbb4-378dd33ffaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807d0b21-f3b1-4036-a8be-12aec88f392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807d0b21-f3b1-4036-a8be-12aec88f392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575867513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287e61e6-5419-4e57-baa0-d2529474f70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:05Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1d70da-d6ce-4c46-a854-81d7fe09e2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1d70da-d6ce-4c46-a854-81d7fe09e2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fa4db8-2819-4a5e-b98b-4786a3cdce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fa4db8-2819-4a5e-b98b-4786a3cdce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287e61e6-5419-4e57-baa0-d2529474f70c', 'volume_name': 'volume-287e61e6-5419-4e57-baa0-d2529474f70c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e1f415-1036-4448-93b3-20a11ad6d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e1f415-1036-4448-93b3-20a11ad6d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaac603-9ce7-458f-b50b-059e2cd6c0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Volume 287e61e6-5419-4e57-baa0-d2529474f70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287e61e6-5419-4e57-baa0-d2529474f70c', 'volume_size': 1} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:05 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c" returned: 0 in 0.258s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575867513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287e61e6-5419-4e57-baa0-d2529474f70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:05Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Creating volume 287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:05 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70226722-c7ce-48cd-bb01-dcc767c8d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5921253d-2580-4f26-a569-01bbc14c101c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:05 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c 1073741824 Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137c1f96-db94-4894-a6c4-cdb207fe5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:05 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:05 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Volume volume-5921253d-2580-4f26-a569-01bbc14c101c (5921253d-2580-4f26-a569-01bbc14c101c): created successfully Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137c1f96-db94-4894-a6c4-cdb207fe5466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (ca7176ea-5c1c-46e2-8865-a2caa3c64259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:05 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1de25d50-d01c-472c-a9db-95fa5f272a94 tempest-ProjectReaderTests-1206862359 None] Created volume successfully. Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-e871d0b1-b409-4b64-bbaf-d311b2338790-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-e871d0b1-b409-4b64-bbaf-d311b2338790-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-quobyte-ad82c851-a353-46ed-b08e-5b343024bbeb" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-ad82c851-a353-46ed-b08e-5b343024bbeb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-quobyte-e871d0b1-b409-4b64-bbaf-d311b2338790" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-e871d0b1-b409-4b64-bbaf-d311b2338790" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Deleting offline snapshot e871d0b1-b409-4b64-bbaf-d311b2338790 of volume ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] snapshot_file for this snap is: volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b1b064-e537-4c0f-9caa-9130a30e55b0]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:06 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 Sep 12 07:34:06 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:06 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c 1073741824" returned: 0 in 0.505s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:06 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c Sep 12 07:34:06 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:06 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790" returned: 0 in 0.398s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad82c851-a353-46ed-b08e-5b343024bbeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d9cd5-8851-4692-b6fc-68ac28862f77]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:06 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c" returned: 0 in 0.281s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaac603-9ce7-458f-b50b-059e2cd6c0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287e61e6-5419-4e57-baa0-d2529474f70c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788b1b80-36f6-43de-8353-6e24aaf1c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:06 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb Sep 12 07:34:06 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:06 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Volume volume-287e61e6-5419-4e57-baa0-d2529474f70c (287e61e6-5419-4e57-baa0-d2529474f70c): created successfully Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788b1b80-36f6-43de-8353-6e24aaf1c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (b62b2f42-3088-41e6-bbb4-378dd33ffaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8c217246-a53d-43a1-9665-9ed8a9578a36 tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-5921253d-2580-4f26-a569-01bbc14c101c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-5921253d-2580-4f26-a569-01bbc14c101c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-quobyte-5921253d-2580-4f26-a569-01bbc14c101c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-5921253d-2580-4f26-a569-01bbc14c101c" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5ee4c-fac8-4bd7-9a52-37f4c14093e7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:06 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:06 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c Sep 12 07:34:06 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb" returned: 0 in 0.535s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:07 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 Sep 12 07:34:07 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:07 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c" returned: 0 in 0.343s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:07 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c Sep 12 07:34:07 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:07 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790" returned: 0 in 0.356s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:07 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790 Sep 12 07:34:07 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:07 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5921253d-2580-4f26-a569-01bbc14c101c" returned: 0 in 0.253s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-5921253d-2580-4f26-a569-01bbc14c101c" released by "delete_volume" :: held 0.641s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Created reservations ['f79c202d-4a1e-4d1a-a831-bff7689e1e00', 'd551d2e7-9638-49f3-b4d2-9d1158e91731', '52e479f3-3d0d-40ed-9ddf-d5d154b40826', 'b34c7ee0-ecbc-40f5-8d80-c7c53e7e1f96'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:07 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb.e871d0b1-b409-4b64-bbaf-d311b2338790" returned: 0 in 0.266s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-e871d0b1-b409-4b64-bbaf-d311b2338790" released by "_delete_snapshot" :: held 1.663s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-ad82c851-a353-46ed-b08e-5b343024bbeb" released by "delete_snapshot" :: held 1.715s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:07 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:07 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Created reservations ['5cbda99f-8bb3-4237-969d-6ab112864ed3', '31d01ead-3ed4-4fe1-9b58-d91af9263b01', 'cb96c60e-e818-4c10-8609-bdaf398d5253', '9ba6f4cf-1109-41c0-9583-dd28b7eb2984'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot a33284d5-1480-4257-82b9-813a4a73736e of volume 287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f737a-c3f9-4da0-9c63-2beb4b34d7ea]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Delete snapshot completed successfully. Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-856f5f8a-abc7-4acf-95d8-0eff475a2091 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-e871d0b1-b409-4b64-bbaf-d311b2338790-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:07 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c Sep 12 07:34:07 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:07 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.279s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Deleted volume successfully. Sep 12 07:34:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-9a8df012-5c5d-49eb-8331-cd391387ec20 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-5921253d-2580-4f26-a569-01bbc14c101c-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-ad82c851-a353-46ed-b08e-5b343024bbeb-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-ad82c851-a353-46ed-b08e-5b343024bbeb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-quobyte-ad82c851-a353-46ed-b08e-5b343024bbeb" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-ad82c851-a353-46ed-b08e-5b343024bbeb" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f8349-caba-4d46-bc52-6ec655a68bc8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:08 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c" returned: 0 in 0.468s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:08 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e 1G Sep 12 07:34:08 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:08 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb Sep 12 07:34:08 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (6266ec34-f5cc-46bb-b84e-a225a41f48e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4948dd-5358-42bb-b300-b8c9084ff8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4948dd-5358-42bb-b300-b8c9084ff8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480723722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da5e851-7c05-4e99-9ef9-5dbfec10921b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:08Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502569c4-3f96-4da5-a4a0-ab7a63fee81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502569c4-3f96-4da5-a4a0-ab7a63fee81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1832b16e-4a4e-47f7-a8fc-2409e381fd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1832b16e-4a4e-47f7-a8fc-2409e381fd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da5e851-7c05-4e99-9ef9-5dbfec10921b', 'volume_name': 'volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b52799b-74ca-43ea-a6a7-29e57249b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b52799b-74ca-43ea-a6a7-29e57249b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a514f4f-2713-463f-8003-5dd163a8a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Volume 8da5e851-7c05-4e99-9ef9-5dbfec10921b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b', 'volume_size': 1} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:08 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb" returned: 0 in 0.386s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:08 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb Sep 12 07:34:08 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:08 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e 1G" returned: 0 in 0.423s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287e61e6-5419-4e57-baa0-d2529474f70c -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:08 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287e61e6-5419-4e57-baa0-d2529474f70c -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e Sep 12 07:34:08 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:08 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad82c851-a353-46ed-b08e-5b343024bbeb" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-ad82c851-a353-46ed-b08e-5b343024bbeb" released by "delete_volume" :: held 0.715s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:08 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Created reservations ['1efbd30a-c335-41f1-9366-fcd250dc27a9', '937e20f3-9f7b-44a4-a9cc-c35426f9c8a4', 'bd3a3e9e-5791-4b80-b510-073f0960a98d', 'd06e5e6a-cf77-42d5-8c1c-edd597efcae4'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:09 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287e61e6-5419-4e57-baa0-d2529474f70c -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e" returned: 0 in 0.294s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:09 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e is being set with open permissions: ugo+rw Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e Sep 12 07:34:09 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:09 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:09 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e" returned: 0 in 0.259s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-4e265499-3812-484b-b279-0f8d272bf7ca-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:09 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:09 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info Sep 12 07:34:09 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.270s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-4e265499-3812-484b-b279-0f8d272bf7ca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Deleted volume successfully. Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-65fb109e-41f6-46f7-872d-fe18b4a9bdbc tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-ad82c851-a353-46ed-b08e-5b343024bbeb-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "cinder-quobyte-4e265499-3812-484b-b279-0f8d272bf7ca" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-4e265499-3812-484b-b279-0f8d272bf7ca" acquired by "delete_volume" :: waited 0.021s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[af603969-16b8-43a2-a4c4-75ee10fd9df2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca Sep 12 07:34:09 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:09 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info" returned: 0 in 0.273s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:09 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info is being set with open permissions: ugo+rw Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info Sep 12 07:34:09 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:09 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.info" returned: 0 in 0.236s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:09 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480723722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da5e851-7c05-4e99-9ef9-5dbfec10921b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6a4a86d7d84960aed105af897a3408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:08Z,use_quota=True,user_id='1cc2aaf1aaad447380e0191b1fb5bb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Creating volume 8da5e851-7c05-4e99-9ef9-5dbfec10921b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:09 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:09 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b 1073741824 Sep 12 07:34:09 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:09 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca Sep 12 07:34:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-28db8655-01ab-4835-a1bf-afc7e05d0bb3 tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:34:09 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:10 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-4e265499-3812-484b-b279-0f8d272bf7ca" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-quobyte-4e265499-3812-484b-b279-0f8d272bf7ca" released by "delete_volume" :: held 0.691s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Created reservations ['89156375-1b92-4fac-96bb-69a1be952855', 'a60a0312-ad38-4442-b765-76b33a90513e', '086eeff3-8b92-482e-bf2d-94929edb788b', '5e24a0e1-bf4e-43c1-9fbd-a48e76c575d7'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:10 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:10 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:10 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b 1073741824" returned: 0 in 0.455s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:10 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b Sep 12 07:34:10 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:10 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Deleted volume successfully. Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-212d41cc-dc84-49e6-a986-7e666d27c032 tempest-SnapshotDependencyTests-253553111 None] Lock "cinder-4e265499-3812-484b-b279-0f8d272bf7ca-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:10 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b" returned: 0 in 0.267s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a514f4f-2713-463f-8003-5dd163a8a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d164c738-21bf-491a-825f-9312efad8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:10 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Volume volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b (8da5e851-7c05-4e99-9ef9-5dbfec10921b): created successfully Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d164c738-21bf-491a-825f-9312efad8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Flow 'volume_create_manager' (6266ec34-f5cc-46bb-b84e-a225a41f48e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:10 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f3e77d00-e03c-4cad-82c8-09694063a3c9 tempest-ProjectReaderTests-1206862359 None] Created volume successfully. Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-a33284d5-1480-4257-82b9-813a4a73736e-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-a33284d5-1480-4257-82b9-813a4a73736e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-287e61e6-5419-4e57-baa0-d2529474f70c" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-287e61e6-5419-4e57-baa0-d2529474f70c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-a33284d5-1480-4257-82b9-813a4a73736e" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-a33284d5-1480-4257-82b9-813a4a73736e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot a33284d5-1480-4257-82b9-813a4a73736e of volume 287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:10 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2c1ca5-dcbb-4146-8361-4cefb069efe4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:11 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e Sep 12 07:34:11 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:11 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e" returned: 0 in 0.382s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287e61e6-5419-4e57-baa0-d2529474f70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49a78e6-feb0-4e58-8805-878522a02325]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:11 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c Sep 12 07:34:11 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-8da5e851-7c05-4e99-9ef9-5dbfec10921b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-8da5e851-7c05-4e99-9ef9-5dbfec10921b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "cinder-quobyte-8da5e851-7c05-4e99-9ef9-5dbfec10921b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-8da5e851-7c05-4e99-9ef9-5dbfec10921b" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef91e673-f089-4ead-874e-e329109b858b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:11 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:11 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e Sep 12 07:34:11 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:11 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b Sep 12 07:34:11 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:12 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b" returned: 0 in 0.408s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:12 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b Sep 12 07:34:12 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:12 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e" returned: 0 in 0.460s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:12 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e Sep 12 07:34:12 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:12 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-8da5e851-7c05-4e99-9ef9-5dbfec10921b" returned: 0 in 0.262s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-quobyte-8da5e851-7c05-4e99-9ef9-5dbfec10921b" released by "delete_volume" :: held 0.717s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Created reservations ['c6d90cda-a1da-4db3-bede-b9cff7b2e9b6', 'ce00b63c-27e7-4505-b293-44f0e1e57b8d', '669e23e2-92ec-4227-84bb-08993b81929d', '410fc30d-de4c-4ab8-b729-e2ef5be818ff'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:12 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c.a33284d5-1480-4257-82b9-813a4a73736e" returned: 0 in 0.260s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-a33284d5-1480-4257-82b9-813a4a73736e" released by "_delete_snapshot" :: held 1.597s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-287e61e6-5419-4e57-baa0-d2529474f70c" released by "delete_snapshot" :: held 1.624s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:12 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:12 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Created reservations ['9a735deb-8310-424e-bdb5-1ddeab894fe3', '1ee24370-9984-41d0-96f7-5a2bbf5260cf', 'e0a2340c-5392-4451-bf09-d460abe5be79', 'a823c270-8200-479f-9a58-88bbd3bfd76b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-ff553928-27f7-41f9-820d-2c1fb2c147b2 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-a33284d5-1480-4257-82b9-813a4a73736e-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:12 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.268s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:12 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Deleted volume successfully. Sep 12 07:34:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3f600b56-7a31-445e-baba-e5e2b938c1c0 tempest-ProjectReaderTests-1206862359 None] Lock "cinder-8da5e851-7c05-4e99-9ef9-5dbfec10921b-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-287e61e6-5419-4e57-baa0-d2529474f70c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Lock "cinder-287e61e6-5419-4e57-baa0-d2529474f70c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-287e61e6-5419-4e57-baa0-d2529474f70c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-287e61e6-5419-4e57-baa0-d2529474f70c" acquired by "delete_volume" :: waited 0.027s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f25aec-f666-4d2f-b070-837cb230254b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:13 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c Sep 12 07:34:13 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:13 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:13 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c Sep 12 07:34:13 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:13 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-287e61e6-5419-4e57-baa0-d2529474f70c" returned: 0 in 0.282s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-287e61e6-5419-4e57-baa0-d2529474f70c" released by "delete_volume" :: held 0.749s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Created reservations ['aefe55a5-79e7-4862-9ebc-b8d95c792039', '885506f4-53b2-4750-89bd-398077eae1f1', '431ab405-b6b6-4ebd-98d9-fa4c38cb2f4f', '185e8b02-d006-4075-a400-51e43887f71b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:14 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:14 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:14 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.295s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-24e68f7b-0510-4a18-b8d7-374332b9958b tempest-ProjectMemberTests-1258291113 None] Lock "cinder-287e61e6-5419-4e57-baa0-d2529474f70c-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (72e8dea2-7051-41e7-a3b1-d5e0768bf841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ea4187-adbe-48b7-ab6c-c81ecb6e109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ea4187-adbe-48b7-ab6c-c81ecb6e109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925930726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad63399c-7eb5-470e-968f-e1a7db04ba4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:15Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8c7472-6487-4d12-bac9-72013b2d25b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8c7472-6487-4d12-bac9-72013b2d25b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a41c7f-e125-4229-87c9-ac98fd030c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a41c7f-e125-4229-87c9-ac98fd030c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad63399c-7eb5-470e-968f-e1a7db04ba4b', 'volume_name': 'volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bbaae2-6891-4d99-b181-2dfd118a31d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bbaae2-6891-4d99-b181-2dfd118a31d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720bf52f-0f20-4d3a-9633-1542ca924a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:14 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Volume ad63399c-7eb5-470e-968f-e1a7db04ba4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b', 'volume_size': 1} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925930726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad63399c-7eb5-470e-968f-e1a7db04ba4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:15Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Creating volume ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:14 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:15 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b 1073741824 Sep 12 07:34:15 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:15 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b 1073741824" returned: 0 in 0.520s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:15 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b Sep 12 07:34:15 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:15 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720bf52f-0f20-4d3a-9633-1542ca924a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a3d39a-8e2a-4824-863c-7062e5d35fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Volume volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b (ad63399c-7eb5-470e-968f-e1a7db04ba4b): created successfully Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a3d39a-8e2a-4824-863c-7062e5d35fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (72e8dea2-7051-41e7-a3b1-d5e0768bf841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:15 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1379cd3b-f321-463c-ae2a-6ffa263e53e9 tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot 20d534e1-2634-482f-9e07-3476f6b22f7f of volume ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe43f5-c40f-46e2-b1cd-18d62c20d075]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:17 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b Sep 12 07:34:17 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:17 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b" returned: 0 in 0.384s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:17 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f 1G Sep 12 07:34:17 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:17 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f 1G" returned: 0 in 0.390s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:17 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f Sep 12 07:34:17 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:18 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f" returned: 0 in 0.278s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:18 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f is being set with open permissions: ugo+rw Sep 12 07:34:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:18 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f Sep 12 07:34:18 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:18 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f" returned: 0 in 0.235s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:18 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info Sep 12 07:34:18 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:18 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info" returned: 0 in 0.296s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:18 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info is being set with open permissions: ugo+rw Sep 12 07:34:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:18 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info Sep 12 07:34:18 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:19 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.info" returned: 0 in 0.261s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:19 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-82b5c5e6-7f4c-4b76-bdc2-57bf35ba981b tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-20d534e1-2634-482f-9e07-3476f6b22f7f-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Lock "cinder-20d534e1-2634-482f-9e07-3476f6b22f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-ad63399c-7eb5-470e-968f-e1a7db04ba4b" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ad63399c-7eb5-470e-968f-e1a7db04ba4b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-20d534e1-2634-482f-9e07-3476f6b22f7f" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-20d534e1-2634-482f-9e07-3476f6b22f7f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot 20d534e1-2634-482f-9e07-3476f6b22f7f of volume ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a87a424-1cd9-4b28-808c-830dfd94f2c4]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:19 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f Sep 12 07:34:19 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:19 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f" returned: 0 in 0.392s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1005c2f-4f02-4842-98e7-02c751196be3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:19 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b Sep 12 07:34:19 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:20 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b" returned: 0 in 0.387s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:20 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f Sep 12 07:34:20 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:20 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:20 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f Sep 12 07:34:20 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:20 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b.20d534e1-2634-482f-9e07-3476f6b22f7f" returned: 0 in 0.257s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-20d534e1-2634-482f-9e07-3476f6b22f7f" released by "_delete_snapshot" :: held 1.474s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ad63399c-7eb5-470e-968f-e1a7db04ba4b" released by "delete_snapshot" :: held 1.502s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Created reservations ['5d54a780-7dd6-4f22-8357-5db4cf00e626', 'bd786d51-2929-4a8b-845a-9ec5506b2241', '14e0bd7f-997a-44a8-a627-2ac83f07e54c', '7562a350-2326-4021-910b-6601032becf5'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-abea0247-c30f-4835-884f-ffbd9c5512ae tempest-ProjectMemberTests-1258291113 None] Lock "cinder-20d534e1-2634-482f-9e07-3476f6b22f7f-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-ad63399c-7eb5-470e-968f-e1a7db04ba4b-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-ad63399c-7eb5-470e-968f-e1a7db04ba4b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-ad63399c-7eb5-470e-968f-e1a7db04ba4b" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ad63399c-7eb5-470e-968f-e1a7db04ba4b" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d34114-c846-40a3-9cc7-c5e81ac7e236]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:21 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b Sep 12 07:34:21 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:21 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b" returned: 0 in 0.355s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:21 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b Sep 12 07:34:21 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:22 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ad63399c-7eb5-470e-968f-e1a7db04ba4b" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ad63399c-7eb5-470e-968f-e1a7db04ba4b" released by "delete_volume" :: held 0.648s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Created reservations ['aed2b04e-5a2b-43f5-b590-b0f9974c1836', 'a0add991-e2d8-467e-a00b-9709b9882192', 'fa6c0323-1342-4765-ba27-be656fce4f26', '32132720-92f1-4388-88fc-b32099b60cf9'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:22 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:22 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:22 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:22 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:22 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d341088f-6be4-4b29-9785-1cd676d26d3c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-ad63399c-7eb5-470e-968f-e1a7db04ba4b-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (22e7d1a2-c1d2-464f-8c48-ff973fbd16ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a5e5f8-e369-4644-94c4-181ae093131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a5e5f8-e369-4644-94c4-181ae093131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490774995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f148b8e2-2ef8-45ec-82be-dbedbfbee9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:23Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f7305f-0339-4d4e-aa76-8627d92527f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f7305f-0339-4d4e-aa76-8627d92527f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5542aae8-5dc8-4750-bc0b-0197ed91bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5542aae8-5dc8-4750-bc0b-0197ed91bec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f148b8e2-2ef8-45ec-82be-dbedbfbee9f0', 'volume_name': 'volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1880f3b5-52be-45f5-9ec2-8204a53b6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1880f3b5-52be-45f5-9ec2-8204a53b6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e2ad3d-bee8-4ed4-b9a9-17d4b58aa67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Volume f148b8e2-2ef8-45ec-82be-dbedbfbee9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0', 'volume_size': 1} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490774995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f148b8e2-2ef8-45ec-82be-dbedbfbee9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:23Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Creating volume f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:23 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:23 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 1073741824 Sep 12 07:34:23 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:23 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 1073741824" returned: 0 in 0.407s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:23 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 Sep 12 07:34:23 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:23 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e2ad3d-bee8-4ed4-b9a9-17d4b58aa67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efe9769-91bf-42e0-ad10-a266cea3e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Volume volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 (f148b8e2-2ef8-45ec-82be-dbedbfbee9f0): created successfully Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efe9769-91bf-42e0-ad10-a266cea3e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (22e7d1a2-c1d2-464f-8c48-ff973fbd16ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-34d62522-9da4-44f2-b2c9-efa72b75abe5 tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot 3e44324c-d73b-433b-ac06-cd1c31aac956 of volume f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[7926450a-2b46-4dec-b248-1769ab44b711]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:24 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 Sep 12 07:34:24 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:24 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" returned: 0 in 0.355s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:24 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 1G Sep 12 07:34:24 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:24 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 1G" returned: 0 in 0.383s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:25 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 Sep 12 07:34:25 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:25 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956" returned: 0 in 0.280s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:25 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 is being set with open permissions: ugo+rw Sep 12 07:34:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:25 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 Sep 12 07:34:25 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:25 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:25 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info Sep 12 07:34:25 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:25 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:25 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info is being set with open permissions: ugo+rw Sep 12 07:34:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:25 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info Sep 12 07:34:25 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:26 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.info" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:26 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-f9a5fc19-16c5-4c47-a506-6e028ec27728 tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-3e44324c-d73b-433b-ac06-cd1c31aac956-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-3e44324c-d73b-433b-ac06-cd1c31aac956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-3e44324c-d73b-433b-ac06-cd1c31aac956" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-3e44324c-d73b-433b-ac06-cd1c31aac956" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot 3e44324c-d73b-433b-ac06-cd1c31aac956 of volume f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a582e-824d-41f5-9061-b9c46f42bf74]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:26 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 Sep 12 07:34:26 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:26 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956" returned: 0 in 0.350s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a29d62-2010-4005-83bd-c0aa9a1804b6]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:26 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 Sep 12 07:34:26 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:27 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:27 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 Sep 12 07:34:27 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:27 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956" returned: 0 in 0.323s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:27 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956 Sep 12 07:34:27 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:27 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0.3e44324c-d73b-433b-ac06-cd1c31aac956" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-3e44324c-d73b-433b-ac06-cd1c31aac956" released by "_delete_snapshot" :: held 1.349s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" released by "delete_snapshot" :: held 1.369s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Created reservations ['1ce2abbd-9650-4f40-977a-583b9b2fc04a', 'b9448986-1f5e-4f39-8b20-25c607e72a71', 'c4f69d7f-0bc2-457e-8ec8-cc0e648ad224', '6f0a420b-435c-4079-85dc-9880c9acdb83'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-cadbcfbf-3594-425a-ade9-e4efd48a346c tempest-ProjectMemberTests-1258291113 None] Lock "cinder-3e44324c-d73b-433b-ac06-cd1c31aac956-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d920d529-ad47-4a87-a2a9-434bf039ba58]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:28 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 Sep 12 07:34:28 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:28 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" returned: 0 in 0.348s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:28 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0 Sep 12 07:34:28 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:29 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0" released by "delete_volume" :: held 0.653s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Created reservations ['58b9ca38-cb18-4dbe-86dd-bd8dc4e17a2e', 'a163c470-2c10-4fa0-8af7-a23a0f7ba173', '91f5a506-8458-4215-a14f-cd8ae55677d1', '221e7bf4-f989-4985-be0e-d3615b03cbd9'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:29 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:29 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:29 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:29 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:29 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-60501212-a5ba-4de7-805f-d28ae6e30540 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-f148b8e2-2ef8-45ec-82be-dbedbfbee9f0-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (c632b9a5-e90c-4432-b68f-38bfa8b628c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a2c995-281a-4f9a-ab27-14ff45f13d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a2c995-281a-4f9a-ab27-14ff45f13d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104982705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12520548-af92-4885-a795-73b154058256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:30Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdf812e-011f-4af0-b235-ec3133777431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdf812e-011f-4af0-b235-ec3133777431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6752b626-0e99-4eb7-a021-201ebb575df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6752b626-0e99-4eb7-a021-201ebb575df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12520548-af92-4885-a795-73b154058256', 'volume_name': 'volume-12520548-af92-4885-a795-73b154058256', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3e9f1c-4004-404d-9ea2-5774bbaa4073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3e9f1c-4004-404d-9ea2-5774bbaa4073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffd6568-35f2-43b9-ba7f-c9277bd3968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:30 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Volume 12520548-af92-4885-a795-73b154058256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12520548-af92-4885-a795-73b154058256', 'volume_size': 1} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104982705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12520548-af92-4885-a795-73b154058256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:30Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Creating volume 12520548-af92-4885-a795-73b154058256 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:30 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:30 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 1073741824 Sep 12 07:34:30 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:30 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:30 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:30 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 1073741824" returned: 0 in 0.414s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:30 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 Sep 12 07:34:30 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:30 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.255s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:34:30 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256" returned: 0 in 0.251s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffd6568-35f2-43b9-ba7f-c9277bd3968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12520548-af92-4885-a795-73b154058256', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40071b96-08d8-4b1b-aeda-7356f0949729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:30 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Volume volume-12520548-af92-4885-a795-73b154058256 (12520548-af92-4885-a795-73b154058256): created successfully Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40071b96-08d8-4b1b-aeda-7356f0949729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (c632b9a5-e90c-4432-b68f-38bfa8b628c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:30 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d45cad08-b109-435c-8ce8-fa48d1ed0b27 tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot 7cc088c0-16e6-40bd-9da3-28c470b8965e of volume 12520548-af92-4885-a795-73b154058256 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bee025-98fe-4506-a6f0-3196927e7a28]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:31 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 Sep 12 07:34:31 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:31 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256" returned: 0 in 0.344s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:31 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e 1G Sep 12 07:34:31 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:31 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e 1G" returned: 0 in 0.385s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:31 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12520548-af92-4885-a795-73b154058256 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:32 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12520548-af92-4885-a795-73b154058256 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e Sep 12 07:34:32 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:32 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12520548-af92-4885-a795-73b154058256 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e" returned: 0 in 0.305s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:32 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e is being set with open permissions: ugo+rw Sep 12 07:34:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:32 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e Sep 12 07:34:32 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:32 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:32 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info Sep 12 07:34:32 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:32 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info" returned: 0 in 0.248s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:32 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info is being set with open permissions: ugo+rw Sep 12 07:34:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:32 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info Sep 12 07:34:32 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:33 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.info" returned: 0 in 0.234s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3d8c1cd9-4722-49c9-b3dc-ca1648257233 tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-7cc088c0-16e6-40bd-9da3-28c470b8965e-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-7cc088c0-16e6-40bd-9da3-28c470b8965e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-12520548-af92-4885-a795-73b154058256" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-12520548-af92-4885-a795-73b154058256" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-7cc088c0-16e6-40bd-9da3-28c470b8965e" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-7cc088c0-16e6-40bd-9da3-28c470b8965e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot 7cc088c0-16e6-40bd-9da3-28c470b8965e of volume 12520548-af92-4885-a795-73b154058256 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76fd134-dd36-42f8-9510-294e8cbbb0c7]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:33 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e Sep 12 07:34:33 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:33 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12520548-af92-4885-a795-73b154058256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600e313-67f5-44eb-a462-41f4038a6728]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:33 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 Sep 12 07:34:33 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:34 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256" returned: 0 in 0.348s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:34 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e Sep 12 07:34:34 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:34 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e" returned: 0 in 0.320s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:34 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e Sep 12 07:34:34 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:34 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256.7cc088c0-16e6-40bd-9da3-28c470b8965e" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-7cc088c0-16e6-40bd-9da3-28c470b8965e" released by "_delete_snapshot" :: held 1.340s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-12520548-af92-4885-a795-73b154058256" released by "delete_snapshot" :: held 1.360s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Created reservations ['4fea5f0e-8fb8-41bb-b0b7-208b6814cb18', 'd8e998dc-7879-4534-a28a-b15a71a91abe', '667911d5-7213-4139-a815-2daf65b45b56', '5134f88d-a5be-440b-9fe2-23302c02ae6a'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-96ffe590-1103-4f46-8bd3-af24ded95b27 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-7cc088c0-16e6-40bd-9da3-28c470b8965e-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-12520548-af92-4885-a795-73b154058256-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-12520548-af92-4885-a795-73b154058256-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-12520548-af92-4885-a795-73b154058256" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-12520548-af92-4885-a795-73b154058256" acquired by "delete_volume" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[2366ba39-ab53-463f-a4c1-1adaa640632a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:35 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 Sep 12 07:34:35 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:35 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256" returned: 0 in 0.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:35 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256 Sep 12 07:34:35 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:36 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-12520548-af92-4885-a795-73b154058256" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-12520548-af92-4885-a795-73b154058256" released by "delete_volume" :: held 0.645s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Created reservations ['8ce3252f-b09c-476c-b968-f092edd94aba', 'a4c00eac-3289-477b-90b1-fe9dac9a5b89', '0b178127-88b0-4544-b938-72d802741b35', 'd179df1b-54c5-4e17-bf10-b9c5c2d45856'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:36 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:36 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:36 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.252s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:36 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-89d7d8d6-35dc-4e98-aa8c-824a2d6c8b60 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-12520548-af92-4885-a795-73b154058256-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (5f15c192-37c8-45d1-8a65-7efed7505357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34c35f8-a275-4339-a674-8cb0efa9c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34c35f8-a275-4339-a674-8cb0efa9c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1556318779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770cfbe7-d7e5-4342-9c37-b443f1370c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:37Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1bd7e4-8eb4-40ed-a740-38126c3746dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1bd7e4-8eb4-40ed-a740-38126c3746dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe26309-963c-488f-9245-252532ddb068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe26309-963c-488f-9245-252532ddb068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770cfbe7-d7e5-4342-9c37-b443f1370c3a', 'volume_name': 'volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d39736-428d-4e2e-890f-9e692bcd6eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d39736-428d-4e2e-890f-9e692bcd6eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ed44b8-9b0f-41ec-b5f8-3ccefa2b2a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:37 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Volume 770cfbe7-d7e5-4342-9c37-b443f1370c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a', 'volume_size': 1} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1556318779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770cfbe7-d7e5-4342-9c37-b443f1370c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:37Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Creating volume 770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:37 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:37 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a 1073741824 Sep 12 07:34:37 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:37 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a 1073741824" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:37 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a Sep 12 07:34:37 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:37 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a" returned: 0 in 0.235s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ed44b8-9b0f-41ec-b5f8-3ccefa2b2a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a908bb2b-56ae-454e-8bb2-94d7085e3542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:37 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Volume volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a (770cfbe7-d7e5-4342-9c37-b443f1370c3a): created successfully Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a908bb2b-56ae-454e-8bb2-94d7085e3542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:37 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (5f15c192-37c8-45d1-8a65-7efed7505357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5ce2aced-44da-4475-ba8a-7ebcb66a9b79 tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot bf784e05-2727-4664-ba15-13c5b6e662d6 of volume 770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ea6df-a106-4ffb-9917-f95d10861c34]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:38 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a Sep 12 07:34:38 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:38 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a" returned: 0 in 0.350s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:38 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 1G Sep 12 07:34:38 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:38 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 1G" returned: 0 in 0.369s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:38 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:38 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 Sep 12 07:34:38 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:39 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6" returned: 0 in 0.277s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:39 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 is being set with open permissions: ugo+rw Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:39 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 Sep 12 07:34:39 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:39 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6" returned: 0 in 0.232s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:39 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info Sep 12 07:34:39 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:39 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:39 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info is being set with open permissions: ugo+rw Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:39 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info Sep 12 07:34:39 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:39 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.info" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:39 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:40 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-67623fd9-dd4a-48cb-acc4-c22f18e43052 tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-bf784e05-2727-4664-ba15-13c5b6e662d6-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-bf784e05-2727-4664-ba15-13c5b6e662d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-770cfbe7-d7e5-4342-9c37-b443f1370c3a" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-770cfbe7-d7e5-4342-9c37-b443f1370c3a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-bf784e05-2727-4664-ba15-13c5b6e662d6" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-bf784e05-2727-4664-ba15-13c5b6e662d6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot bf784e05-2727-4664-ba15-13c5b6e662d6 of volume 770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5c4c7-07c4-4753-87d0-306c9c915fbb]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:40 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 Sep 12 07:34:40 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:40 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6" returned: 0 in 0.342s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae82509-2c3a-4791-8511-923027f73c77]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:40 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:40 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a Sep 12 07:34:40 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:41 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:41 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 Sep 12 07:34:41 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:41 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6" returned: 0 in 0.328s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:41 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6 Sep 12 07:34:41 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:41 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a.bf784e05-2727-4664-ba15-13c5b6e662d6" returned: 0 in 0.234s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-bf784e05-2727-4664-ba15-13c5b6e662d6" released by "_delete_snapshot" :: held 1.339s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-770cfbe7-d7e5-4342-9c37-b443f1370c3a" released by "delete_snapshot" :: held 1.359s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Created reservations ['d85fd797-538f-4710-892f-77031b3c50a9', 'eed4c8f3-6b23-4789-9002-f5cee9c1a62b', 'd1561721-4dea-4ccf-8c17-49728ca0766f', 'f2317128-3f2b-4e50-a7a2-456045f0b931'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:41 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:41 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-02f4d67b-6881-4168-a7a7-e682c948f885 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-bf784e05-2727-4664-ba15-13c5b6e662d6-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-770cfbe7-d7e5-4342-9c37-b443f1370c3a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Lock "cinder-770cfbe7-d7e5-4342-9c37-b443f1370c3a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-770cfbe7-d7e5-4342-9c37-b443f1370c3a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-770cfbe7-d7e5-4342-9c37-b443f1370c3a" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b499d74-39ea-481e-bfdc-e28d1c6e95de]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:42 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a Sep 12 07:34:42 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:42 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a" returned: 0 in 0.344s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:42 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:42 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a Sep 12 07:34:42 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:43 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-770cfbe7-d7e5-4342-9c37-b443f1370c3a" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-770cfbe7-d7e5-4342-9c37-b443f1370c3a" released by "delete_volume" :: held 0.645s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Created reservations ['233275f2-f0dd-4825-bae1-2414aa78e2ee', 'eecae1d1-f4cb-46fb-8777-8d3ecec41d79', 'de3e9f83-1602-4d33-9432-a421e6aa7728', '13ec4cc8-c2f1-4374-92a8-2a7751a02c04'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:43 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:43 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:43 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:43 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:43 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-fab008cb-0f5e-4c01-ae9b-01e29ddaa5fd tempest-ProjectMemberTests-1258291113 None] Lock "cinder-770cfbe7-d7e5-4342-9c37-b443f1370c3a-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (30dc1de9-2556-414a-ab88-47f51293f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00823bfb-efa8-4a5f-9ed9-5f5cf0575f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00823bfb-efa8-4a5f-9ed9-5f5cf0575f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505443284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef544d2e-2b78-4399-ac33-c1f8fb74eb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:44Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d8b7f2-a1a2-4a0e-8db0-a7dd016ae83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d8b7f2-a1a2-4a0e-8db0-a7dd016ae83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf65e70-a4fa-4631-ae48-82eadea72d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf65e70-a4fa-4631-ae48-82eadea72d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef544d2e-2b78-4399-ac33-c1f8fb74eb9c', 'volume_name': 'volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6a0199-97bc-479e-9c0a-2e0d1b29bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6a0199-97bc-479e-9c0a-2e0d1b29bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5888e7c-278a-479b-9e74-0dc7684de7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Volume ef544d2e-2b78-4399-ac33-c1f8fb74eb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c', 'volume_size': 1} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505443284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef544d2e-2b78-4399-ac33-c1f8fb74eb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce1369093ce420d95bcb22e9ee57d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:44Z,use_quota=True,user_id='26d514a69dc346a7b725f2a1e910b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Creating volume ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:44 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:44 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c 1073741824 Sep 12 07:34:44 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:44 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c 1073741824" returned: 0 in 0.406s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:44 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c Sep 12 07:34:44 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:44 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5888e7c-278a-479b-9e74-0dc7684de7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfa26e6-32c9-4ed0-bca4-89a3dc7fc08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:44 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Volume volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c (ef544d2e-2b78-4399-ac33-c1f8fb74eb9c): created successfully Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfa26e6-32c9-4ed0-bca4-89a3dc7fc08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:44 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Flow 'volume_create_manager' (30dc1de9-2556-414a-ab88-47f51293f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:44 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-1668a249-ea18-47d8-91f5-05d293a0923e tempest-ProjectMemberTests-1258291113 None] Created volume successfully. Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Creating offline snapshot 2831fd0c-a330-4569-9c1c-2153138e3235 of volume ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e82a17d-844f-4e28-b6e0-3f908a08b1f9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:45 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c Sep 12 07:34:45 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:45 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:45 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 1G Sep 12 07:34:45 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:45 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 1G" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:45 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:45 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 Sep 12 07:34:45 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:46 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235" returned: 0 in 0.285s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:46 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 is being set with open permissions: ugo+rw Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:46 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 Sep 12 07:34:46 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:46 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235" returned: 0 in 0.233s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:46 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info Sep 12 07:34:46 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:46 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:46 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info is being set with open permissions: ugo+rw Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:46 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info Sep 12 07:34:46 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:46 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.info" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:46 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:47 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b3d19f47-4c2a-473b-96e4-b1c2d3d7f6fd tempest-ProjectMemberTests-1258291113 None] Create snapshot completed successfully Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-2831fd0c-a330-4569-9c1c-2153138e3235-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-2831fd0c-a330-4569-9c1c-2153138e3235-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-2831fd0c-a330-4569-9c1c-2153138e3235" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-2831fd0c-a330-4569-9c1c-2153138e3235" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Deleting offline snapshot 2831fd0c-a330-4569-9c1c-2153138e3235 of volume ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] snapshot_file for this snap is: volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa261ac-522a-4f58-bd12-3e0b16686a43]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:47 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 Sep 12 07:34:47 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:47 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235" returned: 0 in 0.339s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0625b32-300b-48c2-a102-dfb6fec704f8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:47 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:47 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c Sep 12 07:34:47 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:48 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" returned: 0 in 0.355s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:48 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 Sep 12 07:34:48 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:48 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235" returned: 0 in 0.332s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:48 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235 Sep 12 07:34:48 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:48 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c.2831fd0c-a330-4569-9c1c-2153138e3235" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-2831fd0c-a330-4569-9c1c-2153138e3235" released by "_delete_snapshot" :: held 1.353s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" released by "delete_snapshot" :: held 1.375s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Created reservations ['acc04f0f-baae-4b4b-9548-4b5500e46bb1', '4939e696-5d7c-4f1f-8aca-d7728f005b04', 'bcfa9eb8-f971-473d-8c8c-8064e0aed238', '1fcc8361-f27d-4236-a7e2-d594b1326ffd'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:48 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Delete snapshot completed successfully. Sep 12 07:34:48 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-8843e93f-4ada-4cde-9e48-466769806959 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-2831fd0c-a330-4569-9c1c-2153138e3235-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "cinder-quobyte-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:49 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:49 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d11464-671e-473f-937c-4528567e5500]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:49 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:49 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c Sep 12 07:34:49 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:50 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" returned: 0 in 0.364s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:50 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c Sep 12 07:34:50 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:50 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" returned: 0 in 0.246s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-quobyte-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c" released by "delete_volume" :: held 0.663s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Created reservations ['282c5304-2b49-4e08-af5e-f970a8eeda3f', '42d2b3de-c1bd-4f9a-aba4-f12e427c4878', '4eadf471-d838-4c6a-86b5-319a88247d6b', 'f4f976ee-8fc5-4989-8fe5-c527df896402'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:50 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:34:50 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:50 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:34:50 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Deleted volume successfully. Sep 12 07:34:50 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-670279ee-151d-4aba-af8e-84051afd9b16 tempest-ProjectMemberTests-1258291113 None] Lock "cinder-ef544d2e-2b78-4399-ac33-c1f8fb74eb9c-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (2d378bd4-bd5e-4777-9265-08d222f258db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cf16c2-84c8-46cd-b9e5-f1c6cbd3f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cf16c2-84c8-46cd-b9e5-f1c6cbd3f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879084250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5fe507-8402-44df-87ab-5b831b31d927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:54Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace75c22-e776-4a3f-8e78-650ddbaff49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace75c22-e776-4a3f-8e78-650ddbaff49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65f45df-94f6-475e-8727-f901fb0b9652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65f45df-94f6-475e-8727-f901fb0b9652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5fe507-8402-44df-87ab-5b831b31d927', 'volume_name': 'volume-3c5fe507-8402-44df-87ab-5b831b31d927', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ff3596-58a4-45d5-88a8-408ac138279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ff3596-58a4-45d5-88a8-408ac138279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0cf35d-204c-4ebd-936b-3752ad02e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Volume 3c5fe507-8402-44df-87ab-5b831b31d927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5fe507-8402-44df-87ab-5b831b31d927', 'volume_size': 1} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879084250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5fe507-8402-44df-87ab-5b831b31d927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:34:54Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Creating volume 3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:34:54 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:54 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 1073741824 Sep 12 07:34:54 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:54 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 1073741824" returned: 0 in 0.429s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:54 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 Sep 12 07:34:54 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:54 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0cf35d-204c-4ebd-936b-3752ad02e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5fe507-8402-44df-87ab-5b831b31d927', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd497657-8115-4f69-b18c-16c1dbc89f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:34:54 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Volume volume-3c5fe507-8402-44df-87ab-5b831b31d927 (3c5fe507-8402-44df-87ab-5b831b31d927): created successfully Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd497657-8115-4f69-b18c-16c1dbc89f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:34:54 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (2d378bd4-bd5e-4777-9265-08d222f258db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:34:54 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-2ac0cf3b-2b2b-45d9-ae85-6cc99d74f22a tempest-ProjectReaderTests-161031225 None] Created volume successfully. Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Creating offline snapshot 19657b4b-0fd8-42c3-be2e-eb95f3471361 of volume 3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1c6fb-50d4-4b1a-916e-6ad43e4516f5]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:55 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 Sep 12 07:34:55 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:55 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927" returned: 0 in 0.345s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:55 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:55 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 1G Sep 12 07:34:55 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:56 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 1G" returned: 0 in 0.370s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5fe507-8402-44df-87ab-5b831b31d927 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:56 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5fe507-8402-44df-87ab-5b831b31d927 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 Sep 12 07:34:56 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:56 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5fe507-8402-44df-87ab-5b831b31d927 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361" returned: 0 in 0.283s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:56 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 is being set with open permissions: ugo+rw Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:56 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 Sep 12 07:34:56 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:56 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361" returned: 0 in 0.235s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:56 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info Sep 12 07:34:56 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:56 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:56 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info is being set with open permissions: ugo+rw Sep 12 07:34:56 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:56 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info Sep 12 07:34:56 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:57 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.info" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:34:57 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-befc5497-c7d6-4acc-b311-b55652edc72c tempest-ProjectReaderTests-161031225 None] Create snapshot completed successfully Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-19657b4b-0fd8-42c3-be2e-eb95f3471361-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Lock "cinder-19657b4b-0fd8-42c3-be2e-eb95f3471361-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-3c5fe507-8402-44df-87ab-5b831b31d927" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-3c5fe507-8402-44df-87ab-5b831b31d927" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-19657b4b-0fd8-42c3-be2e-eb95f3471361" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-19657b4b-0fd8-42c3-be2e-eb95f3471361" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Deleting offline snapshot 19657b4b-0fd8-42c3-be2e-eb95f3471361 of volume 3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] snapshot_file for this snap is: volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0b50e-0bf1-467f-877e-b55438ce7b17]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:57 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 Sep 12 07:34:57 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:57 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361" returned: 0 in 0.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:57 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5fe507-8402-44df-87ab-5b831b31d927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[877a5935-8c73-4a8a-a083-6815fae42933]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:58 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 Sep 12 07:34:58 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:58 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:58 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 Sep 12 07:34:58 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:58 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361" returned: 0 in 0.327s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:58 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361 Sep 12 07:34:58 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:34:58 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927.19657b4b-0fd8-42c3-be2e-eb95f3471361" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-19657b4b-0fd8-42c3-be2e-eb95f3471361" released by "_delete_snapshot" :: held 1.340s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:58 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-3c5fe507-8402-44df-87ab-5b831b31d927" released by "delete_snapshot" :: held 1.362s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Created reservations ['30eb8c1e-faa4-48c0-b5a6-21dc8f0461b1', 'ac99b60b-9094-4b6d-ab22-e69adfd8b113', '09308c75-5381-434a-b70c-084d85853cbe', '3b680ac0-b1e9-4bdb-a754-bcdf1caf7f54'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:34:59 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Delete snapshot completed successfully. Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-bbf93361-a774-41b8-bc1a-4a048ed5e505 tempest-ProjectReaderTests-161031225 None] Lock "cinder-19657b4b-0fd8-42c3-be2e-eb95f3471361-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-3c5fe507-8402-44df-87ab-5b831b31d927-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Lock "cinder-3c5fe507-8402-44df-87ab-5b831b31d927-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-3c5fe507-8402-44df-87ab-5b831b31d927" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-3c5fe507-8402-44df-87ab-5b831b31d927" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c09008-ccff-4379-8f6f-cc5995418968]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:34:59 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:34:59 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 Sep 12 07:34:59 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:00 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927" returned: 0 in 0.352s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:00 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927 Sep 12 07:35:00 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:00 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-3c5fe507-8402-44df-87ab-5b831b31d927" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-3c5fe507-8402-44df-87ab-5b831b31d927" released by "delete_volume" :: held 0.646s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Created reservations ['6f98f87b-ec09-46bc-8bda-15b3cb1b72ba', 'e159511f-4491-4039-a99d-424ea09143d0', '5b29c133-b880-47d1-a1f7-d28a6a160b84', 'fad14ea7-ad83-4552-ba45-3a8a4b91224d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:00 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:00 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:00 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:00 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Deleted volume successfully. Sep 12 07:35:00 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-eb66f7b6-f38e-4b0a-ac2e-d760f62cbf64 tempest-ProjectReaderTests-161031225 None] Lock "cinder-3c5fe507-8402-44df-87ab-5b831b31d927-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (5826d31c-5d34-4e3e-8ece-75e8d32980d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cc6fb4-9341-49aa-b28c-c6ce36c97e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cc6fb4-9341-49aa-b28c-c6ce36c97e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915319478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa5347e-06c8-4b69-a420-dfbe3bf36346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:01Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c36a09-4942-4783-91e9-fb4f983f7269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c36a09-4942-4783-91e9-fb4f983f7269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b2d6d2-2e31-48e8-b738-0f7fdbb1cfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b2d6d2-2e31-48e8-b738-0f7fdbb1cfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa5347e-06c8-4b69-a420-dfbe3bf36346', 'volume_name': 'volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fe86d7-cbd9-49da-85b5-42c53bdb5ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fe86d7-cbd9-49da-85b5-42c53bdb5ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3849a77-3054-478a-9fe3-44e00d0b320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:01 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Volume 5fa5347e-06c8-4b69-a420-dfbe3bf36346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346', 'volume_size': 1} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915319478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa5347e-06c8-4b69-a420-dfbe3bf36346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:01Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Creating volume 5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:35:01 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:01 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 1073741824 Sep 12 07:35:01 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:01 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 1073741824" returned: 0 in 0.400s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:01 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:01 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 Sep 12 07:35:01 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:02 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3849a77-3054-478a-9fe3-44e00d0b320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3435d053-f7d1-4420-8cfe-86ec4c04af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:02 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Volume volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 (5fa5347e-06c8-4b69-a420-dfbe3bf36346): created successfully Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3435d053-f7d1-4420-8cfe-86ec4c04af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (5826d31c-5d34-4e3e-8ece-75e8d32980d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:02 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-9e507235-42b4-4b52-a792-b4ecf0d95883 tempest-ProjectReaderTests-161031225 None] Created volume successfully. Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Creating offline snapshot 7180c9dc-b1f4-4ce4-aa04-56a4a7405657 of volume 5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bea9b5-b465-4a5d-95fb-c815ae7e1f9a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:02 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 Sep 12 07:35:02 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:02 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:02 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:02 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 1G Sep 12 07:35:02 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:03 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 1G" returned: 0 in 0.372s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:03 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 Sep 12 07:35:03 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:03 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657" returned: 0 in 0.277s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:03 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 is being set with open permissions: ugo+rw Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:03 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 Sep 12 07:35:03 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:03 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:03 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info Sep 12 07:35:03 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:03 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:03 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info is being set with open permissions: ugo+rw Sep 12 07:35:03 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:03 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info Sep 12 07:35:03 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:04 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.info" returned: 0 in 0.256s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:INSERT=58,cinder:UPDATE=188,cinder:SELECT=124,cinder:DELETE=12 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:UPDATE=177,cinder:DELETE=18,cinder:SELECT=145,cinder:INSERT=40 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:35:04 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-b6be7037-2415-4ee9-96ef-8c6646b0bae5 tempest-ProjectReaderTests-161031225 None] Create snapshot completed successfully Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-7180c9dc-b1f4-4ce4-aa04-56a4a7405657-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Lock "cinder-7180c9dc-b1f4-4ce4-aa04-56a4a7405657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-5fa5347e-06c8-4b69-a420-dfbe3bf36346" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-5fa5347e-06c8-4b69-a420-dfbe3bf36346" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-7180c9dc-b1f4-4ce4-aa04-56a4a7405657" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-7180c9dc-b1f4-4ce4-aa04-56a4a7405657" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Deleting offline snapshot 7180c9dc-b1f4-4ce4-aa04-56a4a7405657 of volume 5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] snapshot_file for this snap is: volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[511fd413-bd24-41c2-b13b-00d2de4f518c]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:04 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 Sep 12 07:35:04 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:04 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[05daddf6-da5a-4af0-88e2-07c07cd1b33d]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:04 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:05 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 Sep 12 07:35:05 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:05 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346" returned: 0 in 0.346s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:05 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 Sep 12 07:35:05 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:05 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657" returned: 0 in 0.326s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:05 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657 Sep 12 07:35:05 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:05 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346.7180c9dc-b1f4-4ce4-aa04-56a4a7405657" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-7180c9dc-b1f4-4ce4-aa04-56a4a7405657" released by "_delete_snapshot" :: held 1.340s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-5fa5347e-06c8-4b69-a420-dfbe3bf36346" released by "delete_snapshot" :: held 1.360s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:05 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Created reservations ['4091c3fb-0e38-423c-99a9-7262e5a9bb56', 'b7e8495e-d891-4a2c-a0c5-98e0fdd96215', '3439e4c8-38b5-46d6-aebc-348e99e64510', 'a4c6bf93-ae1b-42c0-9e8e-c1f57f2c118b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:06 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Delete snapshot completed successfully. Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-4af7e498-a741-4f9e-8e6e-c2b9d4405bfa tempest-ProjectReaderTests-161031225 None] Lock "cinder-7180c9dc-b1f4-4ce4-aa04-56a4a7405657-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-5fa5347e-06c8-4b69-a420-dfbe3bf36346-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Lock "cinder-5fa5347e-06c8-4b69-a420-dfbe3bf36346-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-5fa5347e-06c8-4b69-a420-dfbe3bf36346" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-5fa5347e-06c8-4b69-a420-dfbe3bf36346" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac5f4e-785b-4c2b-9ff6-dc61276fa5a8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:06 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:06 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 Sep 12 07:35:06 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:07 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346" returned: 0 in 0.353s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:07 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346 Sep 12 07:35:07 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:07 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-5fa5347e-06c8-4b69-a420-dfbe3bf36346" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-5fa5347e-06c8-4b69-a420-dfbe3bf36346" released by "delete_volume" :: held 0.644s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Created reservations ['f292d08c-acb3-4af8-b032-339614fd1ef6', 'b652b7b0-cef5-4198-a511-917a5a269ff8', 'e81e80fa-956f-4e57-b2dc-510975385c12', 'aeb14f51-3ed3-4bf0-87ca-cc688cf2e9a4'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:07 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:07 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:07 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:07 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Deleted volume successfully. Sep 12 07:35:07 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-298f7300-1266-459a-8bb9-8990aa36ee1c tempest-ProjectReaderTests-161031225 None] Lock "cinder-5fa5347e-06c8-4b69-a420-dfbe3bf36346-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (9fe16882-8253-4369-bd07-5dd29d9c332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db2de7a-5de2-4d70-8e15-46ff6590e6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db2de7a-5de2-4d70-8e15-46ff6590e6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278011087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69652373-217b-4f24-97f6-ecff3af3a4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:08Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d40b4c-0ece-4d27-b9d6-dad06b9a1a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d40b4c-0ece-4d27-b9d6-dad06b9a1a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a29a6b6-1696-4a36-9876-0b5658236aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a29a6b6-1696-4a36-9876-0b5658236aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69652373-217b-4f24-97f6-ecff3af3a4fe', 'volume_name': 'volume-69652373-217b-4f24-97f6-ecff3af3a4fe', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62462d24-d4e8-463d-86fa-d6c3d85229ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62462d24-d4e8-463d-86fa-d6c3d85229ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51848caf-71e3-44a0-a37b-1d36977cea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:08 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Volume 69652373-217b-4f24-97f6-ecff3af3a4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69652373-217b-4f24-97f6-ecff3af3a4fe', 'volume_size': 1} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278011087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69652373-217b-4f24-97f6-ecff3af3a4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:08Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Creating volume 69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:35:08 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:08 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe 1073741824 Sep 12 07:35:08 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:08 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe 1073741824" returned: 0 in 0.413s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:08 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:08 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe Sep 12 07:35:08 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:09 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51848caf-71e3-44a0-a37b-1d36977cea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69652373-217b-4f24-97f6-ecff3af3a4fe', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d02342b-d12a-4962-b3e6-3ba95a755e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:09 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Volume volume-69652373-217b-4f24-97f6-ecff3af3a4fe (69652373-217b-4f24-97f6-ecff3af3a4fe): created successfully Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d02342b-d12a-4962-b3e6-3ba95a755e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (9fe16882-8253-4369-bd07-5dd29d9c332f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:09 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-94377f63-8b1a-4960-99f8-550063dd32c5 tempest-ProjectReaderTests-161031225 None] Created volume successfully. Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Creating offline snapshot 76bb80e1-5927-4b64-abda-512cc0d4422a of volume 69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b5b6f-9a55-4099-9326-60c263bae4b2]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:09 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe Sep 12 07:35:09 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:09 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:09 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:09 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a 1G Sep 12 07:35:09 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:10 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a 1G" returned: 0 in 0.383s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69652373-217b-4f24-97f6-ecff3af3a4fe -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:10 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69652373-217b-4f24-97f6-ecff3af3a4fe -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a Sep 12 07:35:10 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:10 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69652373-217b-4f24-97f6-ecff3af3a4fe -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a" returned: 0 in 0.284s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:10 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a is being set with open permissions: ugo+rw Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:10 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a Sep 12 07:35:10 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:10 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:10 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info Sep 12 07:35:10 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:10 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:10 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info is being set with open permissions: ugo+rw Sep 12 07:35:10 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:10 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info Sep 12 07:35:10 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:11 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.info" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:11 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e7b55c2a-512f-45c5-8c61-2bb4d648ef22 tempest-ProjectReaderTests-161031225 None] Create snapshot completed successfully Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-76bb80e1-5927-4b64-abda-512cc0d4422a-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Lock "cinder-76bb80e1-5927-4b64-abda-512cc0d4422a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-69652373-217b-4f24-97f6-ecff3af3a4fe" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-69652373-217b-4f24-97f6-ecff3af3a4fe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-76bb80e1-5927-4b64-abda-512cc0d4422a" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-76bb80e1-5927-4b64-abda-512cc0d4422a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Deleting offline snapshot 76bb80e1-5927-4b64-abda-512cc0d4422a of volume 69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] snapshot_file for this snap is: volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d617f0-2004-4525-9888-e41355e60b12]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:11 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a Sep 12 07:35:11 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:11 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a" returned: 0 in 0.348s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69652373-217b-4f24-97f6-ecff3af3a4fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ade17-8f82-4653-a61b-ff90725ec26b]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:11 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:12 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe Sep 12 07:35:12 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:12 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:12 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a Sep 12 07:35:12 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:12 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a" returned: 0 in 0.332s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:12 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a Sep 12 07:35:12 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:12 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe.76bb80e1-5927-4b64-abda-512cc0d4422a" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-76bb80e1-5927-4b64-abda-512cc0d4422a" released by "_delete_snapshot" :: held 1.356s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-69652373-217b-4f24-97f6-ecff3af3a4fe" released by "delete_snapshot" :: held 1.377s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:12 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Created reservations ['6c2832a4-df52-4937-a0ba-e5d49729bc9e', '5addcae4-e6c1-46df-b348-bc14222d6fa7', '1f0344b4-db36-4ce7-a3d4-98944b15c0ad', 'dc3bfed2-7a9e-4c63-9aef-1b7ddc558e26'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:13 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Delete snapshot completed successfully. Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-5f5ae040-17ff-493f-9d5c-4ea9299548ef tempest-ProjectReaderTests-161031225 None] Lock "cinder-76bb80e1-5927-4b64-abda-512cc0d4422a-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-69652373-217b-4f24-97f6-ecff3af3a4fe-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Lock "cinder-69652373-217b-4f24-97f6-ecff3af3a4fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-69652373-217b-4f24-97f6-ecff3af3a4fe" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-69652373-217b-4f24-97f6-ecff3af3a4fe" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19fa8c-7d1d-42e5-a478-305fcd31cdbb]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:13 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:13 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe Sep 12 07:35:13 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:14 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe" returned: 0 in 0.352s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:14 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe Sep 12 07:35:14 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:14 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-69652373-217b-4f24-97f6-ecff3af3a4fe" returned: 0 in 0.236s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-69652373-217b-4f24-97f6-ecff3af3a4fe" released by "delete_volume" :: held 0.644s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Created reservations ['460ff23f-3dfc-4770-92fc-e784d655ad5a', '90b12388-20de-4ed8-8536-fef0389e2ec7', 'c35e6ba8-e3b3-47ef-9c7f-2b4274753c7a', '5dba7455-c170-4291-9c9a-d0b2b191f43b'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:14 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:14 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:14 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:14 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Deleted volume successfully. Sep 12 07:35:14 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d980b94b-2401-4a2a-947b-7b5c02fd70c9 tempest-ProjectReaderTests-161031225 None] Lock "cinder-69652373-217b-4f24-97f6-ecff3af3a4fe-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (60e1f85b-3d19-4a73-9ec6-84e3dcb4dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216f1a90-ca19-4f11-87da-f454e1e4dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216f1a90-ca19-4f11-87da-f454e1e4dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771806670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97915db-4c4f-49c5-bf1a-445ce4736ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:15Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe1698c-ef89-47e6-a270-c072c4f4f0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe1698c-ef89-47e6-a270-c072c4f4f0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22db0eb5-86b9-4f6e-8d16-273a4b2a87be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22db0eb5-86b9-4f6e-8d16-273a4b2a87be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97915db-4c4f-49c5-bf1a-445ce4736ff7', 'volume_name': 'volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f947121-449a-480c-8dff-610c07b33fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f947121-449a-480c-8dff-610c07b33fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b05fc57-712c-4dbd-87cf-2cf7a6c34ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:15 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Volume c97915db-4c4f-49c5-bf1a-445ce4736ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7', 'volume_size': 1} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771806670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97915db-4c4f-49c5-bf1a-445ce4736ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:15Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Creating volume c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:35:15 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:15 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 1073741824 Sep 12 07:35:15 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:15 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 1073741824" returned: 0 in 0.399s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:15 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 Sep 12 07:35:15 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:15 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b05fc57-712c-4dbd-87cf-2cf7a6c34ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:15 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fc1c2d-be20-41ce-a43e-1d2fc8361112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:16 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Volume volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 (c97915db-4c4f-49c5-bf1a-445ce4736ff7): created successfully Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fc1c2d-be20-41ce-a43e-1d2fc8361112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (60e1f85b-3d19-4a73-9ec6-84e3dcb4dd15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:16 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-602fcd04-6ffb-4c3b-81f7-4eff59e16787 tempest-ProjectReaderTests-161031225 None] Created volume successfully. Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Creating offline snapshot a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 of volume c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ace0c7-589b-4306-b414-bf2a3e3b3e46]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:16 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 Sep 12 07:35:16 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:16 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:16 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:16 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 1G Sep 12 07:35:16 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:17 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 1G" returned: 0 in 0.403s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:17 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 Sep 12 07:35:17 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:17 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" returned: 0 in 0.292s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:17 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 is being set with open permissions: ugo+rw Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:17 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 Sep 12 07:35:17 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:17 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:17 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info Sep 12 07:35:17 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:17 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:17 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info is being set with open permissions: ugo+rw Sep 12 07:35:17 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:18 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info Sep 12 07:35:18 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:18 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.info" returned: 0 in 0.239s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:18 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-44666f87-ce99-4307-8ea2-fde24caf760b tempest-ProjectReaderTests-161031225 None] Create snapshot completed successfully Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-a00f841d-1e2d-4af0-bcc0-07b2a600f8f5-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Lock "cinder-a00f841d-1e2d-4af0-bcc0-07b2a600f8f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-c97915db-4c4f-49c5-bf1a-445ce4736ff7" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-c97915db-4c4f-49c5-bf1a-445ce4736ff7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Deleting offline snapshot a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 of volume c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] snapshot_file for this snap is: volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[065737b2-e5a1-4107-8e85-e91a4d2e74e9]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:18 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 Sep 12 07:35:18 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:18 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" returned: 0 in 0.354s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff5cb41-5352-4244-b477-45e6797314e8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:18 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:19 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 Sep 12 07:35:19 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:19 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:19 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 Sep 12 07:35:19 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:19 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" returned: 0 in 0.327s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:19 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5 Sep 12 07:35:19 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:19 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7.a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" returned: 0 in 0.238s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-a00f841d-1e2d-4af0-bcc0-07b2a600f8f5" released by "_delete_snapshot" :: held 1.350s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-c97915db-4c4f-49c5-bf1a-445ce4736ff7" released by "delete_snapshot" :: held 1.369s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:19 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Created reservations ['ee7d9f33-9ac8-4a57-a010-830221b206bc', '335675ac-0bd8-400e-bb87-23aa8c3148e3', 'a97cd18d-c637-4c49-968e-0b8c2ea27576', '3bb395c4-4ab0-4401-938b-75911dbaffd2'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:20 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Delete snapshot completed successfully. Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-d942c962-aed2-4514-9712-cf695f2c9c49 tempest-ProjectReaderTests-161031225 None] Lock "cinder-a00f841d-1e2d-4af0-bcc0-07b2a600f8f5-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-c97915db-4c4f-49c5-bf1a-445ce4736ff7-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Lock "cinder-c97915db-4c4f-49c5-bf1a-445ce4736ff7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-c97915db-4c4f-49c5-bf1a-445ce4736ff7" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-c97915db-4c4f-49c5-bf1a-445ce4736ff7" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2954138-10e2-49e3-8e42-b4da18eb05e8]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:20 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:20 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 Sep 12 07:35:20 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:21 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7" returned: 0 in 0.351s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:21 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7 Sep 12 07:35:21 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:21 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-c97915db-4c4f-49c5-bf1a-445ce4736ff7" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-c97915db-4c4f-49c5-bf1a-445ce4736ff7" released by "delete_volume" :: held 0.650s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Created reservations ['3a330d08-4206-47e6-a375-b72d2552857b', '946e0a23-3ac3-43af-88ad-619533e1f3c9', 'ffcf93fd-f4f9-4c65-a61d-8136c5dccfdc', '090a9f7e-2da7-4c2e-82c5-9eccdb5eef48'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:21 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:21 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:21 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.247s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:21 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Deleted volume successfully. Sep 12 07:35:21 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-3c377e51-acdd-4f5e-846d-bdf73fe02a83 tempest-ProjectReaderTests-161031225 None] Lock "cinder-c97915db-4c4f-49c5-bf1a-445ce4736ff7-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (3fe69a61-8f6f-41ad-82af-c80e25acc86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731a06e-5b0d-4ac2-bf99-d8553f481c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731a06e-5b0d-4ac2-bf99-d8553f481c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926429573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d50b18-1994-488a-920b-7f81de2e3a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:22Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b31e52-63d4-480b-8e68-4217f62c13c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b31e52-63d4-480b-8e68-4217f62c13c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d3a8d5-86c9-4857-9ee9-1ce73fbb6d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d3a8d5-86c9-4857-9ee9-1ce73fbb6d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d50b18-1994-488a-920b-7f81de2e3a6a', 'volume_name': 'volume-39d50b18-1994-488a-920b-7f81de2e3a6a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ba9c4d-9c90-4d12-940d-3ef007bc4e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ba9c4d-9c90-4d12-940d-3ef007bc4e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf05e79e-8861-4197-b68a-8b770fbdf305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:22 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Volume 39d50b18-1994-488a-920b-7f81de2e3a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d50b18-1994-488a-920b-7f81de2e3a6a', 'volume_size': 1} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926429573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d50b18-1994-488a-920b-7f81de2e3a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3484ddd23a164af489cc116df1e7a175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:22Z,use_quota=True,user_id='2abb4448a73f44b28a6f3444cabf2e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Creating volume 39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:35:22 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:22 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a 1073741824 Sep 12 07:35:22 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:22 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a 1073741824" returned: 0 in 0.401s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:22 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a Sep 12 07:35:22 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:22 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf05e79e-8861-4197-b68a-8b770fbdf305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d50b18-1994-488a-920b-7f81de2e3a6a', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:22 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a621d4d-c36d-42ad-a28c-0b5c27e8a4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:23 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Volume volume-39d50b18-1994-488a-920b-7f81de2e3a6a (39d50b18-1994-488a-920b-7f81de2e3a6a): created successfully Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a621d4d-c36d-42ad-a28c-0b5c27e8a4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Flow 'volume_create_manager' (3fe69a61-8f6f-41ad-82af-c80e25acc86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:23 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-10cb0608-38c6-4ac3-b680-05db90bb9560 tempest-ProjectReaderTests-161031225 None] Created volume successfully. Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Creating offline snapshot d67c90f4-2969-4732-b2e7-21ffcedfe5d8 of volume 39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d2bcd-f091-4881-9fff-ad4fb3973006]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:23 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a Sep 12 07:35:23 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:23 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a" returned: 0 in 0.361s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:23 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 1G {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:23 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 1G Sep 12 07:35:23 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:24 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 1G" returned: 0 in 0.383s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d50b18-1994-488a-920b-7f81de2e3a6a -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:24 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d50b18-1994-488a-920b-7f81de2e3a6a -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 Sep 12 07:35:24 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:24 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d50b18-1994-488a-920b-7f81de2e3a6a -F qcow2 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8" returned: 0 in 0.294s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:24 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 is being set with open permissions: ugo+rw Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:24 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 Sep 12 07:35:24 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:24 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8" returned: 0 in 0.237s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:24 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info Sep 12 07:35:24 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:24 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info" returned: 0 in 0.250s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:24 devstack cinder-volume[88013]: WARNING cinder.volume.drivers.remotefs [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info is being set with open permissions: ugo+rw Sep 12 07:35:24 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:24 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info Sep 12 07:35:24 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:25 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.info" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:25 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-78d9427d-bfe5-4833-af7c-996f2891c073 tempest-ProjectReaderTests-161031225 None] Create snapshot completed successfully Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-d67c90f4-2969-4732-b2e7-21ffcedfe5d8-delete_snapshot" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Lock "cinder-d67c90f4-2969-4732-b2e7-21ffcedfe5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-39d50b18-1994-488a-920b-7f81de2e3a6a" by "delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-39d50b18-1994-488a-920b-7f81de2e3a6a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-d67c90f4-2969-4732-b2e7-21ffcedfe5d8" by "_delete_snapshot" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-d67c90f4-2969-4732-b2e7-21ffcedfe5d8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Deleting offline snapshot d67c90f4-2969-4732-b2e7-21ffcedfe5d8 of volume 39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] snapshot_file for this snap is: volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 {{(pid=88013) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed147e8-9f70-4a8b-950e-576f7a84ccf3]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:25 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 Sep 12 07:35:25 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:25 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8" returned: 0 in 0.350s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39d50b18-1994-488a-920b-7f81de2e3a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88013) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[a303caf4-53a5-40d4-861e-64188aaaf9dc]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:25 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:26 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a Sep 12 07:35:26 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:26 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a" returned: 0 in 0.349s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:26 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 Sep 12 07:35:26 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:26 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8" returned: 0 in 0.320s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:26 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8 Sep 12 07:35:26 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:26 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a.d67c90f4-2969-4732-b2e7-21ffcedfe5d8" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-d67c90f4-2969-4732-b2e7-21ffcedfe5d8" released by "_delete_snapshot" :: held 1.344s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-39d50b18-1994-488a-920b-7f81de2e3a6a" released by "delete_snapshot" :: held 1.364s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:26 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Created reservations ['705f8e93-e104-42ca-9d39-2421147b708b', '02794bdc-dca6-450f-8036-8799099c6457', '6b8afaf1-8518-4fa1-9f20-0dcd135877ab', 'abe0a941-a45e-4f65-94ea-a9fbd1369557'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:27 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Delete snapshot completed successfully. Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e57d6e92-2f1b-4408-95a8-1f574754f414 tempest-ProjectReaderTests-161031225 None] Lock "cinder-d67c90f4-2969-4732-b2e7-21ffcedfe5d8-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-39d50b18-1994-488a-920b-7f81de2e3a6a-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Lock "cinder-39d50b18-1994-488a-920b-7f81de2e3a6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Acquiring lock "cinder-quobyte-39d50b18-1994-488a-920b-7f81de2e3a6a" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-39d50b18-1994-488a-920b-7f81de2e3a6a" acquired by "delete_volume" :: waited 0.014s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5625fa-5154-4e7b-941a-54dd35ad87bf]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:27 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:27 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a Sep 12 07:35:27 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:28 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a" returned: 0 in 0.347s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:28 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a Sep 12 07:35:28 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:28 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-39d50b18-1994-488a-920b-7f81de2e3a6a" returned: 0 in 0.242s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Lock "cinder-quobyte-39d50b18-1994-488a-920b-7f81de2e3a6a" released by "delete_volume" :: held 0.649s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Created reservations ['b1693ca5-2997-4533-8c1a-5386ccefdf3d', '8c9baeb1-d591-47f4-803d-45462aa90c71', 'f9581f59-8aab-4f08-b1e5-63530ec00c6b', 'ce04c0df-75f7-4bd0-9ae7-beeb9739bd72'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:28 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:28 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:28 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:28 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Deleted volume successfully. Sep 12 07:35:28 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-dde40b3b-cb22-4413-b68d-4fc23eca6008 tempest-ProjectReaderTests-161031225 None] Lock "cinder-39d50b18-1994-488a-920b-7f81de2e3a6a-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:30 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:30 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:30 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.255s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG oslo_service.periodic_task [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] Running periodic task VolumeManager._thread_info {{(pid=88013) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread count: 28 {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 12 07:35:30 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-47676a6a-6f5d-4bf6-a740-a0d05dd8a4a5 None None] thread info: [<_MainThread(MainThread, started 140519804067968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88013) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Flow 'volume_create_manager' (d0dab1ac-ffcd-41c5-a2a9-e8087489c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e83d3fc-8d9b-4a10-830f-e882f0759f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e83d3fc-8d9b-4a10-830f-e882f0759f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228768961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1766c3e-a7e5-460a-bdc3-d388b96fda9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab62782d52e4099ad25369bd519724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:32Z,use_quota=True,user_id='077e431a4ac74dcb87c55cee3a5bc67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5316329c-5dda-411d-b3d3-dd21ac047712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5316329c-5dda-411d-b3d3-dd21ac047712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c28c211-5d84-4799-a8fd-cab44257dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c28c211-5d84-4799-a8fd-cab44257dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1766c3e-a7e5-460a-bdc3-d388b96fda9e', 'volume_name': 'volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f4d22-eced-4443-97fb-63818d8c202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f4d22-eced-4443-97fb-63818d8c202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e339d21-26a1-4ef5-b329-b38bc998289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:32 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Volume d1766c3e-a7e5-460a-bdc3-d388b96fda9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e', 'volume_size': 1} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228768961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1766c3e-a7e5-460a-bdc3-d388b96fda9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab62782d52e4099ad25369bd519724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:32Z,use_quota=True,user_id='077e431a4ac74dcb87c55cee3a5bc67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Creating volume d1766c3e-a7e5-460a-bdc3-d388b96fda9e {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:35:32 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:32 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e 1073741824 Sep 12 07:35:32 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:32 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e 1073741824" returned: 0 in 0.391s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:32 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e Sep 12 07:35:32 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:32 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e" returned: 0 in 0.243s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:35:32 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e339d21-26a1-4ef5-b329-b38bc998289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e473a56-8687-4bd8-9009-79d0368373a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:33 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Volume volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e (d1766c3e-a7e5-460a-bdc3-d388b96fda9e): created successfully Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e473a56-8687-4bd8-9009-79d0368373a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Flow 'volume_create_manager' (d0dab1ac-ffcd-41c5-a2a9-e8087489c15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:33 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-4fe0f15b-3f8f-4d6a-bb97-96045e6867b6 tempest-ProjectReaderTests-988079116 None] Created volume successfully. Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Acquiring lock "cinder-d1766c3e-a7e5-460a-bdc3-d388b96fda9e-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Lock "cinder-d1766c3e-a7e5-460a-bdc3-d388b96fda9e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Acquiring lock "cinder-quobyte-d1766c3e-a7e5-460a-bdc3-d388b96fda9e" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Lock "cinder-quobyte-d1766c3e-a7e5-460a-bdc3-d388b96fda9e" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c463bf-66c5-4f74-912f-8f09339fe30f]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:33 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e Sep 12 07:35:33 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:33 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e" returned: 0 in 0.340s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:33 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:33 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e Sep 12 07:35:33 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:34 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-d1766c3e-a7e5-460a-bdc3-d388b96fda9e" returned: 0 in 0.241s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Lock "cinder-quobyte-d1766c3e-a7e5-460a-bdc3-d388b96fda9e" released by "delete_volume" :: held 0.617s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Created reservations ['a23ab43d-b039-49d4-a25c-1e1331350f25', '8537efea-e8d7-45bb-9998-252687abfbc7', '6056fa25-cef2-40f3-a156-c2d0b19ca3e9', 'e7fc18c1-9e4f-4c52-ab4c-a7cf7af08d8d'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:34 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:34 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:34 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.249s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:34 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Deleted volume successfully. Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-15d7c9a2-ddab-428c-805e-e9963e118f11 tempest-ProjectReaderTests-988079116 None] Lock "cinder-d1766c3e-a7e5-460a-bdc3-d388b96fda9e-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88013) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Flow 'volume_create_manager' (fd9f5ac6-130e-4a8f-bd56-badc6bdcbb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16744528-ccd6-4915-bc53-87f8e7d83915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:34 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16744528-ccd6-4915-bc53-87f8e7d83915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354876970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab62782d52e4099ad25369bd519724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:35Z,use_quota=True,user_id='077e431a4ac74dcb87c55cee3a5bc67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f6a890-1bd9-4796-a0a3-52405a8af31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f6a890-1bd9-4796-a0a3-52405a8af31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d14730d-830a-4607-8281-c8a40515f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d14730d-830a-4607-8281-c8a40515f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7', 'volume_name': 'volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffd5416-f158-4d33-829c-f10c8940e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffd5416-f158-4d33-829c-f10c8940e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc4c43-a4e1-48e5-8513-92ff1a621f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:35 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Volume 15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7', 'volume_size': 1} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-12T05:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354876970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab62782d52e4099ad25369bd519724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T05:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T05:35:35Z,use_quota=True,user_id='077e431a4ac74dcb87c55cee3a5bc67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e3fe21f-ff98-4cb5-a796-835b7ad23222),volume_type_id=4e3fe21f-ff98-4cb5-a796-835b7ad23222)}" {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.remotefs [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Creating volume 15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 {{(pid=88013) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Selected osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 as target Quobyte volume. {{(pid=88013) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 12 07:35:35 devstack cinder-volume[88013]: INFO cinder.volume.drivers.remotefs [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] casted to osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287 Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 1073741824 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:35 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 1073741824 Sep 12 07:35:35 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:35 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 1073741824" returned: 0 in 0.400s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:35 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 Sep 12 07:35:35 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:35 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7" returned: 0 in 0.244s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'} {{(pid=88013) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc4c43-a4e1-48e5-8513-92ff1a621f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7', 'volume_size': 1}' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f47c78-4738-429c-b7b7-58d9a2511fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 12 07:35:35 devstack cinder-volume[88013]: INFO cinder.volume.flows.manager.create_volume [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Volume volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 (15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7): created successfully Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f47c78-4738-429c-b7b7-58d9a2511fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88013) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 12 07:35:35 devstack cinder-volume[88013]: DEBUG cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Flow 'volume_create_manager' (fd9f5ac6-130e-4a8f-bd56-badc6bdcbb0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88013) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 12 07:35:35 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-c3169361-cbd5-4bc0-bb0f-74e1cc7270b4 tempest-ProjectReaderTests-988079116 None] Created volume successfully. Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Acquiring lock "cinder-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7-delete_volume" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Lock "cinder-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Acquiring lock "cinder-quobyte-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7" by "delete_volume" {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Lock "cinder-quobyte-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7" acquired by "delete_volume" :: waited 0.015s {{(pid=88013) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f779e4-e7be-4071-be69-a68ffd059a5a]: (4, 'qcow2') {{(pid=89192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:36 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 Sep 12 07:35:36 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:36 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7" returned: 0 in 0.357s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:36 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7 Sep 12 07:35:36 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:36 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d/volume-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7" returned: 0 in 0.245s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Lock "cinder-quobyte-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7" released by "delete_volume" :: held 0.640s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.quota [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Created reservations ['cb0316d9-2235-43fc-a8a5-e54846fe8a6e', '77db4873-bb00-43ad-9927-dc54ea3dc179', '3c00b26c-919e-476f-a135-d00a09166958', 'c3589a4d-8288-4bc0-8cc8-46c36bea6793'] {{(pid=88013) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287': None} {{(pid=88013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG cinder.volume.drivers.quobyte [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92875659-9e01-48a8-9146-dd0cbd6a5287'] {{(pid=88013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.lockutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 12 07:35:36 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 12 07:35:36 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d Sep 12 07:35:36 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 12 07:35:37 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Sep 12 07:35:37 devstack cinder-volume[88013]: DEBUG oslo_concurrency.processutils [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b247c895310ab6b5f96cebba1d609f9d" returned: 0 in 0.240s {{(pid=88013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 12 07:35:37 devstack cinder-volume[88013]: DEBUG cinder.manager [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Notifying Schedulers of capabilities ... {{(pid=88013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 12 07:35:37 devstack cinder-volume[88013]: INFO cinder.volume.manager [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Deleted volume successfully. Sep 12 07:35:37 devstack cinder-volume[88013]: DEBUG cinder.coordination [None req-e879a783-73b5-47c3-a367-0d2125270be7 tempest-ProjectReaderTests-988079116 None] Lock "cinder-15d64ab3-b5f0-4c40-9b1b-1d2ce14e49c7-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88013) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 12 07:35:46 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:DELETE=6,cinder:SELECT=72,cinder:INSERT=19,cinder:UPDATE=83 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 12 07:35:47 devstack cinder-volume[88013]: DEBUG dbcounter [-] [88013] Writing DB stats cinder:SELECT=59,cinder:INSERT=29,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=88013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}